I’m trying to do Iceberg data files compaction via below code snippet.
SparkActions
.get()
.rewriteDataFiles(table)
.option(“target-file-size-bytes”, (128 * 1024 * 1024).toString)
.execute()
But I’m unable to apply filter of timestamp on it without getting error.