cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Update metastore bucket

gg_047320_gg_94
New Contributor II

Hello,

Our Databricks workspace is currently hosted on AWS account1, while the meta store bucket is configured within a separate AWS account2. We want to transfer this bucket to account1 to eliminate our reliance on account2. How to configure this bucket and migrate the data without any downtime?

Thank you.

2 REPLIES 2

Kaniz_Fatma
Community Manager
Community Manager

Hi @gg_047320_gg_94To migrate your metastore bucket from AWS account2 to account1 without any downtime, you need to create a new bucket in the account1 and then configure it as your new metastore.

Here are the steps:

1. **Create the S3 bucket in account1**: Create a new S3 bucket in account1. This bucket should be in the same region as your Databricks workspaces. Follow AWS's bucket naming rules and create a unique name.

2. **Create a storage configuration record**: This record represents the root S3 bucket. You can create it by calling the create storage configuration API. The API request should include the storage_configuration_name (a new unique storage configuration name) and root_bucket_info (a JSON object that contains a bucket_name field with your S3 bucket name).

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi, You can use: https://github.com/databrickslabs/migrate/blob/master/METASTORE.md# for the metastore data migration. 

Please tag @Debayan with your next comment which will get me notified. 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group