02-20-2023 03:32 AM
I am going to create a Metasore following the documentation.
Regarding the storage account, I don't understand if it should be in the same region as Metastore.
From documentation:
You can create no more than one metastore per region. It is recommended that you use the same region for your metastore and storage container.
Is it a recommendation or a must?
Another part of the documentation:
02-22-2023 02:55 AM
Hi @Mohammad Saber, Creating your Azure storage account and Metastore in the same region is recommended to optimize performance and reduce latency.
When your storage account and Metastore are located in the same region, the data transfer between them will occur within the same data center, which can reduce network latency and improve performance. Additionally, having your storage account and Metastore in the same region can help ensure your data is stored and processed in compliance with regional data residency regulations.
However, there may be cases where it makes sense to create your storage account and Metastore in different regions. For example, if you have users or applications in different regions that need to access the same data, it may be more efficient to distribute your data across multiple regions. In these cases, you should consider using Azure Data Share or Azure Data Factory to replicate your data across regions.
Ultimately, whether to create your Azure storage account and Metastore in the same region depends on your specific requirements and use case.
Before deciding, you should carefully evaluate your data access patterns, performance needs, compliance requirements, and other factors.
02-20-2023 09:41 AM
@Mohammad Saber : Yes, it is mandatory that the Workspace and metastore are in the same region.
02-20-2023 04:20 PM
Thanks.
But the question is about the region for Storage Account & Metastore.
02-22-2023 02:55 AM
Hi @Mohammad Saber, Creating your Azure storage account and Metastore in the same region is recommended to optimize performance and reduce latency.
When your storage account and Metastore are located in the same region, the data transfer between them will occur within the same data center, which can reduce network latency and improve performance. Additionally, having your storage account and Metastore in the same region can help ensure your data is stored and processed in compliance with regional data residency regulations.
However, there may be cases where it makes sense to create your storage account and Metastore in different regions. For example, if you have users or applications in different regions that need to access the same data, it may be more efficient to distribute your data across multiple regions. In these cases, you should consider using Azure Data Share or Azure Data Factory to replicate your data across regions.
Ultimately, whether to create your Azure storage account and Metastore in the same region depends on your specific requirements and use case.
Before deciding, you should carefully evaluate your data access patterns, performance needs, compliance requirements, and other factors.