How to migrate an existing workspace for an external metastore

[alonisser]

Currently we're on an azure databricks workspace, we've setup during the POC, a long time ago. In the meanwhile we have built quite a production workload above databricks.

Now we want to split workspaces - one for analysts and one for data engineering as adviced by Azure. And we need an external metastore as a common metastore for both

I know I can create a new workspace with a new external metastore , but what I need is to migrate the existing one. How can this be achieved?

[Hubert-Dudek · Accepted solution]

From databricks notebook just run mysqldump. Server address and details you can take from logs or configuration.

I am including also link to example notebook https://docs.microsoft.com/en-us/azure/databricks/kb/_static/notebooks/2016-election-tweets.html

[alonisser]

Wow thanks for that. I'll try this.

[Hubert-Dudek]

Actually I plan to do video about that so stay tuned 🙂