Does size of optimized files after running OPTIMIZE varies between cloud providers (S3, Blob and GCS)?

Srikanth_Gupta_
Databricks Employee
Databricks Employee

are there any other parameters to consider running OPTIMIZE depending cloud vendor?

Ryan_Chynoweth
Databricks Employee
Databricks Employee

The optimize is not dependent on the cloud provider whatsoever. Optimize will produce the same results regardless of the underlying storage. It is idempotent, meaning if it is run twice on the same dataset the the second execution has no effect.

View solution in original post