cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Houston
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Can someone post about how the ci/cd process for a lakehouse fits into a ring environment? What is the recommended way for someone to synchronize the lakehouse in the production ring with any of the lower ring environments?

JY1
New Contributor II

For example, with traditional sql databases, we just take a production backup and restore to whatever environment as needed. I have not seen similar functionality in regards to the Lakehouse/spark tables.

1 REPLY 1

Mike_C
New Contributor III
New Contributor III

Customers typically use Delta Cloning to "clone" Delta Lake datasets/sub-datasets to other environments for development, testing, etc. See this blog: https://www.databricks.com/blog/2020/09/15/easily-clone-your-delta-lake-for-testing-sharing-and-ml-r...

If customers don't want to move the data, but allow it to be securely accessed across environments, maybe even for a specific time window, they might also use Delta Sharing. https://learn.microsoft.com/en-us/azure/databricks/data-sharing/delta-sharing/

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group