jose_gonzalez
Databricks Employee
Databricks Employee

hi @guruv​ ,

@Werner Stinckens​  is correct. Auto optimize will try to create files of 128 MB within each partition. On the other hand, explicit optimize will compress more and create files of 1 GB each (default value). You can customize the default value according to your use case.