Hi Brahma,

Thank you so much for your detailed explanation and clear recommendations! Partitioning by year and month, combined with regularly running OPTIMIZE … ZORDER BY day, makes perfect sense for balancing performance and manageability at this scale. I’ll implement this approach and monitor file sizes and query speed as you suggested.

If you have any tips on how often I should schedule the OPTIMIZE job for a 50 TiB table, I’d greatly appreciate it.

Thanks again for your help!

Best regards,
Yutaro