[Databricks Asset Bundles] Changes are not showing when deploying for a second time
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-11-2024 10:19 AM
Hi all
I've followed this guide https://docs.databricks.com/en/dev-tools/bundles/work-tasks.html and managed to deploy a notebook using DABs, but I then changed the cluster settings and ran the deploy line again and it didn't change the cluster.
I deleted the job and re-ran the deploy line and it still deployed the old cluster settings.
I changed the notebook name from notebook to notebook2.ipynbin the YAML and of the notebook and it still deployed the first version (though this time it failed validation - it claims notebook.ipynb can't be found... thought when I search for it nowhere is looking for it).
Seems as if something is cached and is not recalculating/building to validate and deploy.
Does anyone know where I'm going wrong?
Thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-11-2024 10:23 AM
Hi @ConfusedZebra,
Sometimes, cached data can cause issues with deployment. Try clearing any local cache and rebuilding the bundle. You can do this by running:
databricks bundle clean
databricks bundle build
databricks bundle deploy
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-12-2024 02:10 AM
Apologies if I'm running these in the wrong place but it doesn't seem to find databricks bundle clean or databricks bundle build - it shows:
Usage:
databricks bundle [command]
Available Commands:
deploy Deploy bundle
deployment Deployment related commands
destroy Destroy deployed bundle resources
generate Generate bundle configuration
init Initialize using a bundle template
open Open a resource in the browser
run Run a job or pipeline update
schema Generate JSON Schema for bundle configuration
summary Summarize resources deployed by this bundle
sync Synchronize bundle tree to the workspace
validate Validate configuration
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-11-2024 10:33 AM
Apologies if I'm running these in the wrong place but it doesn't seem to find databricks bundle clean or databricks bundle build - it shows:
Usage:
databricks bundle [command]
Available Commands:
deploy Deploy bundle
deployment Deployment related commands
destroy Destroy deployed bundle resources
generate Generate bundle configuration
init Initialize using a bundle template
open Open a resource in the browser
run Run a job or pipeline update
schema Generate JSON Schema for bundle configuration
summary Summarize resources deployed by this bundle
sync Synchronize bundle tree to the workspace
validate Validate configuration
