topic daabricks workflow design in Data Engineering

daabricks workflow design

Anish_2 — Tue, 13 Jan 2026 18:16:22 GMT

Hello Team,

I have use-case in which i want to trigger another dlt pipeline if 1 table got succeded in my parent dlt pipeline. I dont want to create pipeline to pipeline dependency. Is there any way to create table to pipeline dependency?

Thank you

Anish

Re: daabricks workflow design

MoJaMa — Wed, 14 Jan 2026 02:51:56 GMT

You can try Table Update Trigger (TUT).

So your pipeline2 will get triggered when there is an "update" to some chosen tables(s) updated in your pipeline1.

https://docs.databricks.com/aws/en/jobs/trigger-table-update

Re: daabricks workflow design

Raman_Unifeye — Wed, 14 Jan 2026 09:24:13 GMT

@Anish_2 - TUT is the solution. in TUT, instead of the parent pipeline "pushing" a notification, the child job is "pulled" into action by a metadata change.

Set it up as below.

Create a Databricks Job and add a Pipeline task pointing to your Secondary DLT pipeline.
In the Job settings panel on the right, click Add trigger.
Choose the Table update trigger type.
Point it to the specific Unity Catalog table generated by your parent DLT pipeline.
Set Sensitivity: Configure a "Minimum time between triggers" to ensure that if the parent pipeline updates the table multiple times in a short window, the child pipeline doesn't restart unnecessarily.

Hope it will give you the desired behaviour.