cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Automatically Vacuuming a Delta Table on Databricks

BarakHav
New Contributor II

Hi all,

I've recently checked my bucket size on AWS and saw that it's size doesn't make much sense. I decided to vacuum each delta table with 2 weeks of retention. That shrunk the data from 30TB to around 5TB, though I was wondering, shouldn't default value of

delta.deletedFileRetentionDuration

kicked in and done it for me?

As far as I know it is 2 weeks, so my vacuuming should have resulted with no change.

1 REPLY 1

Kaniz
Community Manager
Community Manager

Hi @Barak Hav​, Here is an excellent article on Vacuum. Please give it a read and let us know if that helps.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.