Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2024 12:13 AM - edited 12-09-2024 12:14 AM
Hi,
It seems you are setting the retention period to 0 hours.
You need to first use this config spark.databricks.delta.retentionDurationCheck.enabled to false.
and then set the retentention duration config as you used.
You can do a DRY RUN to check if there are any files which are ready to be vacummed.
Reference link: https://docs.databricks.com/en/sql/language-manual/delta-vacuum.html