https://community.databricks.com/t5/machine-learning/what-file-statistics-does-optimize-return-how-can-i-use-them-to/m-p/21590#M1189 <P>Optimize is largely designed as a data organization strategy for Delta Tables. Its help by compacting small files, collecting columns stats to help with data skipping and also Z-ordering of data if that's called explicitly can help with both read/write performance on Delta Tables. See this for additional details - <A href="https://docs.databricks.com/delta/optimizations/file-mgmt.html" target="test_blank">https://docs.databricks.com/delta/optimizations/file-mgmt.html</A></P> Wed, 23 Jun 2021 03:24:33 GMT aladda 2021-06-23T03:24:33Z https://community.databricks.com/t5/machine-learning/what-file-statistics-does-optimize-return-how-can-i-use-them-to/m-p/21589#M1188 Wed, 23 Jun 2021 02:07:37 GMT https://community.databricks.com/t5/machine-learning/what-file-statistics-does-optimize-return-how-can-i-use-them-to/m-p/21589#M1188 Anonymous 2021-06-23T02:07:37Z https://community.databricks.com/t5/machine-learning/what-file-statistics-does-optimize-return-how-can-i-use-them-to/m-p/21590#M1189 <P>Optimize is largely designed as a data organization strategy for Delta Tables. Its help by compacting small files, collecting columns stats to help with data skipping and also Z-ordering of data if that's called explicitly can help with both read/write performance on Delta Tables. See this for additional details - <A href="https://docs.databricks.com/delta/optimizations/file-mgmt.html" target="test_blank">https://docs.databricks.com/delta/optimizations/file-mgmt.html</A></P> Wed, 23 Jun 2021 03:24:33 GMT https://community.databricks.com/t5/machine-learning/what-file-statistics-does-optimize-return-how-can-i-use-them-to/m-p/21590#M1189 aladda 2021-06-23T03:24:33Z