cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Should I create Azure storage & Metastore in the same region?

Mado
Valued Contributor II

I am going to create a Metasore following the documentation.

Regarding the storage account, I don't understand if it should be in the same region as Metastore.

From documentation:

You can create no more than one metastore per region. It is recommended that you use the same region for your metastore and storage container.

Is it a recommendation or a must?

Another part of the documentation:

image 

1 ACCEPTED SOLUTION

Accepted Solutions

Kaniz
Community Manager
Community Manager

Hi @Mohammad Saber​, Creating your Azure storage account and Metastore in the same region is recommended to optimize performance and reduce latency.

When your storage account and Metastore are located in the same region, the data transfer between them will occur within the same data center, which can reduce network latency and improve performance. Additionally, having your storage account and Metastore in the same region can help ensure your data is stored and processed in compliance with regional data residency regulations.

However, there may be cases where it makes sense to create your storage account and Metastore in different regions. For example, if you have users or applications in different regions that need to access the same data, it may be more efficient to distribute your data across multiple regions. In these cases, you should consider using Azure Data Share or Azure Data Factory to replicate your data across regions.

Ultimately, whether to create your Azure storage account and Metastore in the same region depends on your specific requirements and use case.

Before deciding, you should carefully evaluate your data access patterns, performance needs, compliance requirements, and other factors.

View solution in original post

3 REPLIES 3

Sivaprasad1
Valued Contributor II

@Mohammad Saber​ : Yes, it is mandatory that the Workspace and metastore are in the same region.

Mado
Valued Contributor II

Thanks.

But the question is about the region for Storage Account & Metastore.

Kaniz
Community Manager
Community Manager

Hi @Mohammad Saber​, Creating your Azure storage account and Metastore in the same region is recommended to optimize performance and reduce latency.

When your storage account and Metastore are located in the same region, the data transfer between them will occur within the same data center, which can reduce network latency and improve performance. Additionally, having your storage account and Metastore in the same region can help ensure your data is stored and processed in compliance with regional data residency regulations.

However, there may be cases where it makes sense to create your storage account and Metastore in different regions. For example, if you have users or applications in different regions that need to access the same data, it may be more efficient to distribute your data across multiple regions. In these cases, you should consider using Azure Data Share or Azure Data Factory to replicate your data across regions.

Ultimately, whether to create your Azure storage account and Metastore in the same region depends on your specific requirements and use case.

Before deciding, you should carefully evaluate your data access patterns, performance needs, compliance requirements, and other factors.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.