topic Re: not using defined clusters when deploying workflows in development mode by asset bundle in Data Engineering

not using defined clusters when deploying workflows in development mode by asset bundle

greenned — Thu, 29 Aug 2024 11:20:04 GMT

Hi, I'm using databricks asset bundle to deploy workflows.

but when i deploy in development mode. the workflows do not use the new clusters, just using existing clusters

can i deploy with the defined new clusters in development mode??

Re: not using defined clusters when deploying workflows in development mode by asset bundle

Satyadeepak — Mon, 13 Jan 2025 18:45:01 GMT

You could use mode: development and then deploy with --compute-id and specify the ID of your personal compute cluster to replace the existing clusters. Only with mode: development will the compute ID replace existing, or per-task cluster specs.