topic How frequently should Optimize be run on a Delta Table in Data Engineering https://community.databricks.com/t5/data-engineering/how-frequently-should-optimize-be-run-on-a-delta-table/m-p/20921#M14169 Thu, 24 Jun 2021 04:16:35 GMT aladda 2021-06-24T04:16:35Z How frequently should Optimize be run on a Delta Table https://community.databricks.com/t5/data-engineering/how-frequently-should-optimize-be-run-on-a-delta-table/m-p/20921#M14169 Thu, 24 Jun 2021 04:16:35 GMT https://community.databricks.com/t5/data-engineering/how-frequently-should-optimize-be-run-on-a-delta-table/m-p/20921#M14169 aladda 2021-06-24T04:16:35Z Re: How frequently should Optimize be run on a Delta Table https://community.databricks.com/t5/data-engineering/how-frequently-should-optimize-be-run-on-a-delta-table/m-p/20922#M14170 <P>Its typically a good idea to run optimize aligned with the frequency of updates to the Delta Table. However you also don't want to over do as there's a cost/performance trade-off. Unless there are very frequent updates to the table that can cause small files or impact data organization signficantly, running optimize once per day is a good strategy</P> Thu, 24 Jun 2021 04:18:00 GMT https://community.databricks.com/t5/data-engineering/how-frequently-should-optimize-be-run-on-a-delta-table/m-p/20922#M14170 aladda 2021-06-24T04:18:00Z