Hi all,
I've recently checked my bucket size on AWS and saw that it's size doesn't make much sense. I decided to vacuum each delta table with 2 weeks of retention. That shrunk the data from 30TB to around 5TB, though I was wondering, shouldn't default value of
delta.deletedFileRetentionDuration
kicked in and done it for me?
As far as I know it is 2 weeks, so my vacuuming should have resulted with no change.