Retention Period for Parquet Data in e.g. S3 After Dropping a Managed Delta Table

Volker
Databricks Partner

Hey community,

I have a question regarding the data retention policy for managed Delta tables stored e.g. in Amazon S3. Specifically:​

  • When a managed Delta table is dropped, what is the retention period for the underlying Parquet data files in S3 before they are permanently deleted?

I understand that Unity Catalog supports the UNDROP TABLE command to recover dropped managed tables within 7 days. However, I am interested in understanding the total duration the data remains in S3 before it is permanently removed.

In the past the documentation mentioned 30 days but I cannot find this information in the current documentation. I guess this was updated since in the german Azure documentation the 30 days are still mentioned: https://learn.microsoft.com/de-de/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-table

Additionally, is there a way to configure this retention period, or expedite the deletion process if immediate removal of data is required?

Thank you!