saurabh18cs
Honored Contributor III

Hi @bricksuser 

looks like a common fan-out orchestration patter. your parent job should triger child job programatically and then capture maintain its run_id. you can use databricks jobs api endpoints to start child job.

Use POST /api/2.1/jobs/run-now or POST /api/2.1/jobs/runs/submit.