iceberg_compaction_commit_batch_size
Number of merged data files that background Iceberg compaction accumulates before publishing them in a new snapshot. Compaction results are published in any case once there are no candidates left to compact, so this setting only bounds how long already merged files stay unpublished while compaction keeps finding new work.0 restores the old behaviour
of publishing only when compaction runs out of candidates - a state that is never reached while the table keeps
receiving new data files, so every merged output is then written to object storage and never referenced by a snapshot.
iceberg_compaction_data_cleanup
The time after which the data will be deleted.iceberg_compaction_delay_bias
Minimum time of delay between 2 background compaction operations.iceberg_compaction_max_bytes_in_data_file
Max bytes of an iceberg parquet data file produced by compaction. The default mirrors the documented default of the Iceberg table propertywrite.target-file-size-bytes (512 MiB),
see https://iceberg.apache.org/docs/1.5.2/configuration/. Keep it above
iceberg_data_file_size_lower_threshold_compaction, otherwise every output file stays below the lower threshold
and is selected for compaction again.
iceberg_compaction_max_rows_in_data_file
Max rows of an iceberg parquet data file produced by compaction. Defaults to the maximum, so the size limiticeberg_compaction_max_bytes_in_data_file alone decides how much data goes into an output file, the same way
Iceberg has no row-count counterpart of write.target-file-size-bytes.