cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

[Databricks Asset Bundles] Changes are not showing when deploying for a second time

ConfusedZebra
Visitor

Hi all

I've followed this guide https://docs.databricks.com/en/dev-tools/bundles/work-tasks.html and managed to deploy a notebook using DABs, but I then changed the cluster settings and ran the deploy line again and it didn't change the cluster.

I deleted the job and re-ran the deploy line and it still deployed the old cluster settings. 

I changed the notebook name from notebook to notebook2.ipynbin the YAML and of the notebook and it still deployed the first version (though this time it failed validation - it claims notebook.ipynb can't be found... thought when I search for it nowhere is looking for it).

 

Seems as if something is cached and is not recalculating/building to validate and deploy. 

Does anyone know where I'm going wrong?

 Thanks!

2 REPLIES 2

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @ConfusedZebra,

Sometimes, cached data can cause issues with deployment. Try clearing any local cache and rebuilding the bundle. You can do this by running:

databricks bundle clean

databricks bundle build

databricks bundle deploy

ConfusedZebra
Visitor

Apologies if I'm running these in the wrong place but it doesn't seem to find databricks bundle clean  or databricks bundle build - it shows:

Usage:

  databricks bundle [command]

 

Available Commands:

  deploy      Deploy bundle

  deployment  Deployment related commands

  destroy     Destroy deployed bundle resources

  generate    Generate bundle configuration

  init        Initialize using a bundle template

  open        Open a resource in the browser

  run         Run a job or pipeline update

  schema      Generate JSON Schema for bundle configuration

  summary     Summarize resources deployed by this bundle

  sync        Synchronize bundle tree to the workspace

  validate    Validate configuration

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group