cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Recover a deleted DLT pipeline

standup1
Contributor

Hello,

does anyone know how to recover a deleted dlt pipeline, or at least recover deleted tables that were managed by the dlt pipeline ? We have a pipeline that stopped working and throwing all kind of errors, so we decided to create a new one and deleted the bad one. However, all tables were deleted along with the pipeline. Luckily, this was just a testing pipeline, but we still canโ€™t figure out how to recover those tables. Any information you can share is greatly appreciated. Thank you 

2 REPLIES 2

Kaniz_Fatma
Community Manager
Community Manager

Hi @standup1

  • Unfortunately, once a DLT pipeline is deleted, it cannot be directly restored. However, you can create a new pipeline to replace the old one.
  • To avoid losing data, consider following these best practices:
    • Version Control: Maintain version control for your pipelines. This way, you can revert to a previous version if needed.
    • Backup Configuration: Regularly back up your pipeline configurations, including table definitions and transformations.
    • Pipeline Monitoring: Set up monitoring and alerts to catch issues early and prevent data loss.
    • The critical part is recovering the tables associated with the deleted pipeline. Hereโ€™s how you can approach this:

standup1
Contributor

Thank you, Kanzi. Just to confirm that I understood you correctly. If the pipeline is deleted [like in our case] without having version control, backup configuration..etc already implemented. There's no way to recover those tables, not the pipeline. my concern is just the tables/data.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group