06-08-2024 09:33 AM - edited 06-08-2024 09:34 AM
Hi ,
I am looking for Databricks DR(Disaster recovery) site creation. My primary setup is in west us and my primary data bricks created in primary site with unity catalog enable. with same meta data i want bring up the Databricks in my secondary side east us when any event occurred.
For notebooks, general data i have approach but i have blocked with Unity catalog data replication [Meta store/Catalog/Schema/Tables].
can some one share approach if you already build the data bricks DR (secondary ) site.
Thanks
RM
06-08-2024 01:43 PM
As of now UC does not have DR setting, this is currently in our prioritized roadmap but no ETA is currently available.
Some customers host an external metastore and replicate it across regions to achieve this.
06-12-2024 09:24 PM
We have done it that way where we have a unity catalog created in secondary region with its own single instance of meta store. Given unity catalog replication is not in place, we run a nightly replication to sync up meta data in primary and secondary.
06-15-2024 10:28 AM
Thank you for your reply. I have replicated the metastore but not able to re-use meta store data in Secondary region. When creating unity catalog in secondary region, I dint got option to re-use metastore data and only have option to create new metastore. please can you elaborate how re using the replicated metastore and catalog data in secondary region.
Thanks
06-15-2024 10:30 AM
Thans for the information.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group