cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

difference between optimize and auto optimize and Optimize in delta

User16826994223
Honored Contributor III

What would be good for me , if I should use Optimize every time or should I be using auto-optimize?

1 REPLY 1

User16869510359
Esteemed Contributor

  • Optimize:  Bin-packing/Compaction. Idempotent and Incremental
  • Optimize + Z-Order: Helps in Data Skipping; Use Range Partitioning
  • Optimize write: Improve the write operation to the Delta table. optimization is performed before the write/during the write.
  • Auto-compaction: Post-commit action Triggered when more than 50 files/directory

Auto-optimize = Optimize Write + Auto-compaction

What is suitable is determined by the use cases.

Reference: