cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Machine Learning
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What file statistics does Optimize return & How can I use them to my advantage?

Anonymous
Not applicable
 
1 REPLY 1

Anand_Ladda
Honored Contributor II

Optimize is largely designed as a data organization strategy for Delta Tables. Its help by compacting small files, collecting columns stats to help with data skipping and also Z-ordering of data if that's called explicitly can help with both read/write performance on Delta Tables. See this for additional details - https://docs.databricks.com/delta/optimizations/file-mgmt.html

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.