cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Disabled S3 bucket version, Next steps?

prashantjjain33
New Contributor II

We have been using Databricks for some time and didn't knew that S3 bucket versioning was not recommended. We have disabled it now. What are the next steps that we need to take to clean up the data, should we create a lifecycle rule to delete older versions manually or there is a way databricks handles that itself. 

PS: We are running vaccum on that tables in our catalogue, but need general guidance on how to manage this situation to save on storage costs without impacting any current flow.

2 REPLIES 2

Yeshwanth
Databricks Employee
Databricks Employee

@prashantjjain33 if you had enabled S3 Versioning, having the S3 Lifecycle is one approach that you can consider.

prashantjjain33
New Contributor II

Adding lifecycle policies to databricks s3 bucket does not impact existing data, is that correct @Yeshwanth .

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group