cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Difference between Delta Live Tables and Multitask Jobs

Anonymous
Not applicable

When should I use one over the other? There seems to be an overlap of some functionality

1 ACCEPTED SOLUTION

Accepted Solutions

aladda
Honored Contributor II
Honored Contributor II
Delta Live Tables are targeted towards building an ETL pipeline where several Delta tables are interconnected from a flow perspective and in a single notebook. Multi-task Jobs is more generic orchestration framework that allows you to execute various Notebooks in a flow

View solution in original post

2 REPLIES 2

User16783855117
Contributor II
Delta Live Tables provides and API for 'declarative data flow'. Instead of writing the code to manually read in data, apply transformations, and write it out, Delta Live tables instead asks you to declare the input source, the transformations, and the intended output source. The managed runtime will automatically optimize under the covers and perform the required reads, bookmarking, and compute logistics. It is very similar to how Terraform is declarative for building cloud infrastructure, whereas Delta Live Tables are declarative for data tables.

aladda
Honored Contributor II
Honored Contributor II
Delta Live Tables are targeted towards building an ETL pipeline where several Delta tables are interconnected from a flow perspective and in a single notebook. Multi-task Jobs is more generic orchestration framework that allows you to execute various Notebooks in a flow
Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.