topic Re: Does size of optimized files after running OPTIMIZE varies between cloud providers (S3, Blob and GCS)? in Data Engineering https://community.databricks.com/t5/data-engineering/does-size-of-optimized-files-after-running-optimize-varies/m-p/22077#M15085 <P>The optimize is not dependent on the cloud provider whatsoever. Optimize will produce the same results regardless of the underlying storage. It is idempotent, meaning if it is run twice on the same dataset the the second execution has no effect. </P> Mon, 21 Jun 2021 18:03:17 GMT Ryan_Chynoweth 2021-06-21T18:03:17Z Does size of optimized files after running OPTIMIZE varies between cloud providers (S3, Blob and GCS)? https://community.databricks.com/t5/data-engineering/does-size-of-optimized-files-after-running-optimize-varies/m-p/22076#M15084 <P>are there any other parameters to consider running OPTIMIZE depending cloud vendor?</P> Mon, 21 Jun 2021 17:17:45 GMT https://community.databricks.com/t5/data-engineering/does-size-of-optimized-files-after-running-optimize-varies/m-p/22076#M15084 Srikanth_Gupta_ 2021-06-21T17:17:45Z Re: Does size of optimized files after running OPTIMIZE varies between cloud providers (S3, Blob and GCS)? https://community.databricks.com/t5/data-engineering/does-size-of-optimized-files-after-running-optimize-varies/m-p/22077#M15085 <P>The optimize is not dependent on the cloud provider whatsoever. Optimize will produce the same results regardless of the underlying storage. It is idempotent, meaning if it is run twice on the same dataset the the second execution has no effect. </P> Mon, 21 Jun 2021 18:03:17 GMT https://community.databricks.com/t5/data-engineering/does-size-of-optimized-files-after-running-optimize-varies/m-p/22077#M15085 Ryan_Chynoweth 2021-06-21T18:03:17Z