โ12-18-2024 10:40 AM
Hello Team,
I am unable to update the Existing Metastore in my AWS databricks.
I have new aws account and I am trying to update my existing workspace, however I am unable to update the s3 bucket details and Network configuration ( greyed out ) in the existing workspace.
Along with it I am unable to update the Metastore which is linked to the workspace with the new aws account.
So usually, how does it work.? how can I update the Metastore and workspace with the new AWS account .?
โ12-18-2024 10:56 AM
This are the actual supported changes that can be run on a running workspace:
https://docs.databricks.com/en/admin/workspace/update-workspace.html#update-a-running-workspace
The Storage and Unity Catalog settings seems to not to be allowed to modify, and for network config you should be using Customer Managed VPC
โ12-18-2024 11:42 AM
Yes, I tried updating the workspace with new configuration, however the storage configuration and metastore is not editable field ( Greyed out ).
And Also I am unable to updated the existing metastore with my new aws config, it is all greyed out.
Thanks.
โ12-18-2024 11:52 AM
Yes because the workspace is in running state and this are not editable settings when the workspace is in running state only in failed as per the doc
โ12-18-2024 11:56 AM
Is there a way to stop the workspace and update the settings ?
If there is no way to stop the workspace, how should I update my new aws account details to the existing workspaces .? should I create a new metastore and new workspace and then migrate all the data from old workspace to new workspace .?
Thanks.
โ12-18-2024 12:05 PM
Let me confirm this to you but it seems that indeed you will need to create a new workspace, also please consider that you can only have 1 metastore per region in the account.
โ12-18-2024 01:29 PM
Sure, Please let me know once you confirm.
โ12-19-2024 06:40 AM
Unfortunately there is no way to move the state of the workspace manually so based on this the solution will be to recreate the workspace and migrate the data
โ12-19-2024 06:43 AM
Sure, Thanks for the update.
is there any documentation where I can follow on how to migrate the data from one workspace to another workspace .?
Thanks.
โ12-19-2024 06:52 AM
You could use the following migration tool: https://github.com/databrickslabs/migrate
โ12-19-2024 09:54 AM
Thanks Walter for the migration tool. Does this migration tool can migrate all the Catalogs and SQL warehouse data from existing workspace to new workspace .?
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group