Hi,
We need to migrate our metastore with Unity Catalog to a new Azure subscription while remaining in the same Azure region. Currently, we have two workspaces attached to a single Unity Catalog. Iām looking for the best approach to move the metastore from one Azure subscription to another.
One idea is to detach both Databricks workspaces and physically move the ADLSāwhich contains our data and Unity Catalogāto the new subscription. After the move, we would delete the old metastore and reconnect the workspaces to the new metastore. Will this approach work? Has anyone had experience with migrating a Databricks metastore?
Additionally, where is the information about catalogs, schemas, and table names stored within the metastore? I have only found a folder named "unitycatalogs" containing generic table names.
Hi @alesventus,
There are few points to be considered before migrating from One metastore to another. We need to see how the catalogs, schemas and tables are created as of now.
If you have created everything has managed like managed catalog, schema and table everything will remain in your unitycatalogs folder that you have highlighted. You can recreate the metastore with the same ADLS container after you have migrated.
If the schemas and tables are created as external. The path(s) will be pointed one-to-one in your ADLS location, so you can recreate the schema with the same locations pointed earlier.
But there are few points to be considered when it comes to managed tables, if you are deleting a metastore:
Attaching the link for your reference: https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/manage-metastore
Please let us know for more clarifications needed.
Best Regards,
Nivethan V
