Update existing Metastores in AWS databricks

[santosh23]

Hello Team,

I am unable to update the Existing Metastore in my AWS databricks. 

I have new aws account and I am trying to update my existing workspace, however I am unable to update the s3 bucket details and Network configuration ( greyed out )  in the existing workspace. 

Along with it I am unable to update the Metastore which is linked to the workspace with the new aws account. 

So usually, how does it work.? how can I update the Metastore and workspace with the new AWS account .? 

[Walter_C]

This are the actual supported changes that can be run on a running workspace:

https://docs.databricks.com/en/admin/workspace/update-workspace.html#update-a-running-workspace

The Storage and Unity Catalog settings seems to not to be allowed to modify, and for network config you should be using Customer Managed VPC

[santosh23]

Yes, I tried updating the workspace with new configuration, however the storage configuration and metastore is not editable field ( Greyed out ). 

And Also I am unable to updated the existing metastore with my new aws config, it is all greyed out.

Thanks. 

[Walter_C]

Yes because the workspace is in running state and this are not editable settings when the workspace is in running state only in failed as per the doc

[santosh23]

Is there a way to stop the workspace and update the settings ? 

If there is no way to stop the workspace, how should I update my new aws account details to the existing workspaces .? should I create a new metastore and new workspace and then migrate all the data from old workspace to new workspace .? 

Thanks.

[Walter_C]

Let me confirm this to you but it seems that indeed you will need to create a new workspace, also please consider that you can only have 1 metastore per region in the account.

[santosh23]

Sure, Please let me know once you confirm. 

[Walter_C]

Unfortunately there is no way to move the state of the workspace manually so based on this the solution will be to recreate the workspace and migrate the data

[santosh23]

Sure, Thanks for the update.

is there any documentation where I can follow on how to migrate the data from one workspace to another workspace .? 

Thanks.

[Walter_C]

You could use the following migration tool: https://github.com/databrickslabs/migrate 

[santosh23]

Thanks Walter for the migration tool. Does this migration tool can migrate all the Catalogs and SQL warehouse data from existing workspace to new workspace .?