azure pipeline databricks bundle deploy duplicating jobs
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-09-2024 12:40 PM
I am deploying an asset bundle using an azure pipeline.
I use
# Databricks Bundle Validate
- bash: |
databricks bundle validate -t $(BUNDLE_TARGET)
displayName: 'Validate Asset Bundle'
# Databricks Bundle Deploy
- bash: |
databricks bundle deploy -t $(BUNDLE_TARGET)
displayName: 'Deploy Asset Bundle'
The bundle is getting deployed to the same root path everytime.
Everytime I run my pipline I get a duplicate of the jobs in my workflows.
This issue just started happening today, yesterday I deployed many times with no duplicates. Please assist.
Thank you
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-12-2024 12:49 AM - edited 09-12-2024 12:51 AM
Hey!
Same problem over here, tried upgrading to the latest version of the Databricks CLI but to no avail.
I did find the issue on Github: https://github.com/databricks/cli/issues/1650
Describe the issue I am encountering problems because sometimes DAB when deploying instead of updating the existing workflows it creates new workflows with exactly the same name, and I end up with duplicated workflows, one the old versio...

