topic Re: how often should I vacuum my Delta table? in Data Engineering https://community.databricks.com/t5/data-engineering/how-often-should-i-vacuum-my-delta-table/m-p/26312#M18397 <P>The requirements for Vacuum will depend on your application needs and the rate of arrival of new data. Vacuuming removes old versions of data.</P><P></P><P>If you need to be able to query earlier versions of data many months after the original ingest time, then it is likely that you will not vacuum older data often. </P><P></P><P>For applications that always operate on the latest version of data, then the main concern is to not break currently running queries. It will also depend on how much data is ingested daily. </P><P></P><P>For many applications , vacuuming weekly or nightly will be sufficient.</P> Mon, 07 Jun 2021 18:26:57 GMT RonanStokes_DB 2021-06-07T18:26:57Z how often should I vacuum my Delta table? https://community.databricks.com/t5/data-engineering/how-often-should-i-vacuum-my-delta-table/m-p/26311#M18396 <P>I would like to know how often do I need to vacuum my delta table to clean old files?</P> Fri, 04 Jun 2021 19:10:20 GMT https://community.databricks.com/t5/data-engineering/how-often-should-i-vacuum-my-delta-table/m-p/26311#M18396 jose_gonzalez 2021-06-04T19:10:20Z Re: how often should I vacuum my Delta table? https://community.databricks.com/t5/data-engineering/how-often-should-i-vacuum-my-delta-table/m-p/26312#M18397 <P>The requirements for Vacuum will depend on your application needs and the rate of arrival of new data. Vacuuming removes old versions of data.</P><P></P><P>If you need to be able to query earlier versions of data many months after the original ingest time, then it is likely that you will not vacuum older data often. </P><P></P><P>For applications that always operate on the latest version of data, then the main concern is to not break currently running queries. It will also depend on how much data is ingested daily. </P><P></P><P>For many applications , vacuuming weekly or nightly will be sufficient.</P> Mon, 07 Jun 2021 18:26:57 GMT https://community.databricks.com/t5/data-engineering/how-often-should-i-vacuum-my-delta-table/m-p/26312#M18397 RonanStokes_DB 2021-06-07T18:26:57Z