cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Delta Live Tables (DLT) in a production environment

serelk
New Contributor III

I’m keen to learn more about employing Distributed Ledger Technology (DLT) in a production environment. Databricks is indeed promoting Delta Live Tables (DLT) as a comprehensive framework for creating robust, maintainable, and testable data processing pipelines.

In our recent project, we've opted to use DLT to construct the bronze layer within a Medallion architecture. Our main concern comes from DLT’s lifecycle being closely tied to its associated data. Specifically, if a DLT pipeline is deleted, all the linked data risks being erased as well. Clearly, no customer can afford to lose months of valuable data due to a single error.

I’m interested to know how others are managing this scenario. Are there efficient recovery procedures in place to handle accidental deletions of a DLT pipeline? Any shared experiences or recommendations would be greatly appreciated."

1 REPLY 1

serelk
New Contributor III

Just a small remark: I definitely meant Delta Live Tables, not Distributed Ledger Technology (DLT)

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group