cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
cancel
Showing results for 
Search instead for 
Did you mean: 

Disabled S3 bucket version, Next steps?

prashantjjain33
New Contributor II

We have been using Databricks for some time and didn't knew that S3 bucket versioning was not recommended. We have disabled it now. What are the next steps that we need to take to clean up the data, should we create a lifecycle rule to delete older versions manually or there is a way databricks handles that itself. 

PS: We are running vaccum on that tables in our catalogue, but need general guidance on how to manage this situation to save on storage costs without impacting any current flow.

2 REPLIES 2

Yeshwanth
Contributor III
Contributor III

@prashantjjain33 if you had enabled S3 Versioning, having the S3 Lifecycle is one approach that you can consider.

prashantjjain33
New Contributor II

Adding lifecycle policies to databricks s3 bucket does not impact existing data, is that correct @Yeshwanth .

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.