Delete S3 files after vacuum

[wwarner]

Hi,

I'm trying to purge a table of stale data. My databricks host is on cloud.databricks.com.

I've set delta.deletedFileRetentionDuration=interval 7 days, deleted many (billions) rows, and followed up with VACUUM tablename RETAIN 168 HOURS, however my databricks filesystem is still full of stale files.

How can I get rid of those files?

Thanks --Bill

[shan_chandra]

Hi Bill - Based on the delta delete file retention period, the files will no longer be there after 7 days .

Thanks, Shan