- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-10-2026 11:29 AM
Hey,
As others have said you can't really do what you're trying to do via DABs. You have to specify each object for deployment and if you redeploy it will overwrite the old objects. There are two potential ways you would deploy the pipelines via DABs.
1. Manually specify each pipeline individually in your DAB but use yaml anchors to avoid repetition
2. Use a script potentially in Python to dynamically create the YAML for the all the combos you need.
At some point in the future Databricks will support Jobs passing parameters to pipelines which could be a better soltution to your problem. You could have all the parameters to pass to your pipeline in a table which the job loops through and passes to the pipeline.
I hope this helps.
Thanks,
Emma