topic region specific issue in Unity catalog in Data Governance

region specific issue in Unity catalog

shahname — Tue, 18 Jun 2024 11:13:36 GMT

Hello,

I am using Unity catalog on my databricks and all of my data resides in data lake which is located in west europe.

I have to onboard the Korea data to UC which is present on data lake pointing to south korea region

My question is do I need to setup a new UC to onboard the korea data or should I create a table in existing UC keeping in mind all the data compliance issue for korea region?

Re: region specific issue in Unity catalog

jacovangelder — Tue, 18 Jun 2024 12:20:52 GMT

I think what you're asking is if you need a new metastore for your Korea data.
The technical answer is no. You can just onboard the Korean storage account as an external location in your west europe based Metastore. However you can't onboard Databricks workspaces into the metastore that have its regions outside of the metastores location. If you plan on adding Korea to your data governance setup, you might want to consider seperating each region with corresponding data assets through different metastores.