topic Re: [Databricks Asset Bundles] Changes are not showing when deploying for a second time in Data Engineering

[Databricks Asset Bundles] Changes are not showing when deploying for a second time

ConfusedZebra — Wed, 11 Dec 2024 18:19:09 GMT

Hi all

I've followed this guide https://docs.databricks.com/en/dev-tools/bundles/work-tasks.html and managed to deploy a notebook using DABs, but I then changed the cluster settings and ran the deploy line again and it didn't change the cluster.

I deleted the job and re-ran the deploy line and it still deployed the old cluster settings.

I changed the notebook name from notebook to notebook2.ipynbin the YAML and of the notebook and it still deployed the first version (though this time it failed validation - it claims notebook.ipynb can't be found... thought when I search for it nowhere is looking for it).

Seems as if something is cached and is not recalculating/building to validate and deploy.

Does anyone know where I'm going wrong?

Thanks!

Re: [Databricks Asset Bundles] Changes are not showing when deploying for a second time

Alberto_Umana — Wed, 11 Dec 2024 18:23:40 GMT

Hi @ConfusedZebra,

Sometimes, cached data can cause issues with deployment. Try clearing any local cache and rebuilding the bundle. You can do this by running:

databricks bundle clean

databricks bundle build

databricks bundle deploy

Re: [Databricks Asset Bundles] Changes are not showing when deploying for a second time

ConfusedZebra — Wed, 11 Dec 2024 18:33:30 GMT

Apologies if I'm running these in the wrong place but it doesn't seem to find databricks bundle clean or databricks bundle build - it shows:

Usage:

databricks bundle [command]

Available Commands:

deploy Deploy bundle

deployment Deployment related commands

destroy Destroy deployed bundle resources

generate Generate bundle configuration

init Initialize using a bundle template

open Open a resource in the browser

run Run a job or pipeline update

schema Generate JSON Schema for bundle configuration

summary Summarize resources deployed by this bundle

sync Synchronize bundle tree to the workspace

validate Validate configuration

Re: [Databricks Asset Bundles] Changes are not showing when deploying for a second time

ConfusedZebra — Thu, 12 Dec 2024 10:10:29 GMT

Apologies if I'm running these in the wrong place but it doesn't seem to find databricks bundle clean or databricks bundle build - it shows:

Usage:

databricks bundle [command]

Available Commands:

deploy Deploy bundle

deployment Deployment related commands

destroy Destroy deployed bundle resources

generate Generate bundle configuration

init Initialize using a bundle template

open Open a resource in the browser

run Run a job or pipeline update

schema Generate JSON Schema for bundle configuration

summary Summarize resources deployed by this bundle

sync Synchronize bundle tree to the workspace

validate Validate configuration