When streaming to a Delta table, both repartitioning on the partition column and optimized write can help to avoid small files.
Which is recommended between Delta Optimized Write vs Repartitioning?
Thanks,
Saikrishna Pujari
Sr. Spark Technical Solutions Engineer, Databricks
