cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Inquire the location of creating a metastore resource

LEE_SUKJUN
New Contributor II

 

I created Databricks on AWS today.
Of course, we're planning to switch to paid.
By the way, the Metastore is in the US Region after I was born.
I'm a Korea APJ, and is the Metastore all only run in the US?
Does the Metastore have no impact if I query or look it up in BI?
Was it automatically created in the US Region because I just made databricks?

Q1. Why do you think 2 Metastores are the default?
Q2. Does it use US Region's Metastore every time? Wouldn't it be slow?

We look forward to hearing from the experts.
Thank you.

 

LEE_SUKJUN_0-1762932473218.png

 

1 REPLY 1

Coffee77
Contributor III

Hi @LEE_SUKJUN , I think the general principle should be to keep all components (metastore, workspace, and cloud storage) in the same region in order to avoid cross-region latency, data egress costs, and compliance issues.

Concerning number of metastores, it depends on your requirements. You can attach several workspaces (DEV, QA, Staging, PROD) to the same metastore taking into account that there is a limitation of one metastore per region unless you get an exception from Databricks support. If needed, you could create another metastore in another region for Business Continuity Plan / Disaster Recovery options and then, attach a new workspace to fail over. In the end, design/architecture depends on your application and needs.


Lifelong Learner Cloud & Data Solution Architect | https://www.youtube.com/@CafeConData