COMPUTE DELTA STATISTICS vs COMPUTE STATISTICS - Data Skipping

Sainath368
Contributor

Hi all,

I recently altered the data skipping stats columns on my Delta Lake table to optimize data skipping. Now, I’m wondering about the best practice for updating statistics:

  • Is running ANALYZE TABLE <table_name> COMPUTE DELTA STATISTICS sufficient after such changes?

  • Or is it necessary to run a full ANALYZE TABLE <table_name> COMPUTE STATISTICS to fully update statistics, especially for newly incoming data?

I want to understand whether COMPUTE DELTA STATISTICS alone keeps the table statistics fully up to date as new data arrives, or if I should regularly run the full COMPUTE STATISTICS command to ensure accuracy.

Thanks in advance for your guidance!