https://community.databricks.com/t5/data-engineering/delete-s3-files-after-vacuum/m-p/55575#M30370 <P>Hi,</P><P>I'm trying to purge a table of stale data. My databricks host is on cloud.databricks.com.</P><P>I've set <FONT face="terminal,monaco">delta.deletedFileRetentionDuration=interval 7 days</FONT>, deleted many (billions) rows, and followed up with <SPAN>VACUUM tablename RETAIN 168 HOURS, </SPAN><SPAN>however my databricks filesystem is still full of stale files.</SPAN></P><P><SPAN>How can I get rid of those files?</SPAN></P><P><SPAN>Thanks --Bill</SPAN></P> Wed, 20 Dec 2023 22:56:53 GMT wwarner 2023-12-20T22:56:53Z https://community.databricks.com/t5/data-engineering/delete-s3-files-after-vacuum/m-p/55575#M30370 <P>Hi,</P><P>I'm trying to purge a table of stale data. My databricks host is on cloud.databricks.com.</P><P>I've set <FONT face="terminal,monaco">delta.deletedFileRetentionDuration=interval 7 days</FONT>, deleted many (billions) rows, and followed up with <SPAN>VACUUM tablename RETAIN 168 HOURS, </SPAN><SPAN>however my databricks filesystem is still full of stale files.</SPAN></P><P><SPAN>How can I get rid of those files?</SPAN></P><P><SPAN>Thanks --Bill</SPAN></P> Wed, 20 Dec 2023 22:56:53 GMT https://community.databricks.com/t5/data-engineering/delete-s3-files-after-vacuum/m-p/55575#M30370 wwarner 2023-12-20T22:56:53Z https://community.databricks.com/t5/data-engineering/delete-s3-files-after-vacuum/m-p/56993#M30708 <P>Hi Bill - Based on the delta delete file retention period, the&nbsp;<SPAN>files will no longer be there after 7 days&nbsp;.</SPAN></P> <P><SPAN>Thanks, Shan</SPAN></P> Thu, 11 Jan 2024 20:42:51 GMT https://community.databricks.com/t5/data-engineering/delete-s3-files-after-vacuum/m-p/56993#M30708 shan_chandra 2024-01-11T20:42:51Z