How to make a DLT pipeline trigger another pipeline?

guangyi — Thu, 20 Jun 2024 09:36:29 GMT

For example, I have 2 DLT pipelines, one is used for computing user gender distribution, another is used for compute user location distribution.

In the first pipeline, I follow the medallion architecture creating the bronze, silver, gold table one by one.

In the second pipeline, considering it related to the user data also, I want reuse the silver table created in the first pipeline.

I implemented the pipeline code successfully. But I don’t know how to achieve this: when the silver table data been updated by the first pipeline, the second pipeline should be triggered as well for updating the data immediately to reflect the latest distribution

topic How to make a DLT pipeline trigger another pipeline? in Data Engineering

How to make a DLT pipeline trigger another pipeline?