Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-21-2022 12:32 PM
Hi @Xiang ZHU ,
DLT is a declarative way (either SQL or Python) to build data pipelines in Databricks that uses Delta tables for each stage in the pipeline and has many features and benefits that running ETL pipelines in a notebook might not have. Jobs are a way to orchestrate tasks in Databricks that may include DLT pipelines and much more.
So while you can use jobs to schedule a DLT pipeline, they don't replace each other. Jobs won't be able to do what DLT does and DLT won't be able to do what Jobs does.
Jobs docs: https://docs.databricks.com/workflows/jobs/jobs.html
DLT docs: https://docs.databricks.com/workflows/delta-live-tables/index.html