Hi Experts
I have around 100 table in the bronze layer (DLT pipeline). We have created silver layer based on some logic around 20 silver layer tables.
How to run the specific pipeline in silver layer when ever there is some update happens in the bronze layer.
Say for ex if i am using t1,t2,t3 then trigger silver pipeline using these tables.
if i am using t5,t11,t13 then trigger silver pipeline using these tables.
So there could be 50 table updates in bronze layer and i need to trigger only those flows in silver layer where 50 tables being used(could be 10 flows in the silver layer)
how to design this flow . Please advise.