topic Automatically Vacuuming a Delta Table on Databricks in Data Engineering https://community.databricks.com/t5/data-engineering/automatically-vacuuming-a-delta-table-on-databricks/m-p/24547#M17077 <P>Hi all,</P><P>I've recently checked my bucket size on AWS and saw that it's size doesn't make much sense. I decided to vacuum each delta table with 2 weeks of retention. That shrunk the data from 30TB to around 5TB, though I was wondering, shouldn't default value of</P><PRE><CODE>delta.deletedFileRetentionDuration</CODE></PRE><P>kicked in and done it for me?</P><P>As far as I know it is 2 weeks, so my vacuuming should have resulted with no change.</P> Sun, 27 Mar 2022 12:19:03 GMT BarakHav 2022-03-27T12:19:03Z Automatically Vacuuming a Delta Table on Databricks https://community.databricks.com/t5/data-engineering/automatically-vacuuming-a-delta-table-on-databricks/m-p/24547#M17077 <P>Hi all,</P><P>I've recently checked my bucket size on AWS and saw that it's size doesn't make much sense. I decided to vacuum each delta table with 2 weeks of retention. That shrunk the data from 30TB to around 5TB, though I was wondering, shouldn't default value of</P><PRE><CODE>delta.deletedFileRetentionDuration</CODE></PRE><P>kicked in and done it for me?</P><P>As far as I know it is 2 weeks, so my vacuuming should have resulted with no change.</P> Sun, 27 Mar 2022 12:19:03 GMT https://community.databricks.com/t5/data-engineering/automatically-vacuuming-a-delta-table-on-databricks/m-p/24547#M17077 BarakHav 2022-03-27T12:19:03Z