topic Re: Databricks Asset Bundle deploy failure in Data Engineering

Databricks Asset Bundle deploy failure

HoussemBL — Wed, 14 Aug 2024 15:17:12 GMT

Hello,

I have deployed successfully a Databricks Job that contains one task of type DLT using Databricks Asset Bundle.

First deployment works well. For this particular Databricks job, I have clicked on "disconnect from source" to do some customization.

Later I did a second deployment using DAB. My second deployment fails stating the following:

Error: cannot create pipeline: The pipeline name 'demo_pipeline' is already used by another pipeline. This check can be skipped by setting `allow_duplicate_names = true` in the request.

Re: Databricks Asset Bundle deploy failure

Walter_C — Mon, 13 Jan 2025 18:47:43 GMT

To fix this, you need to set the allow_duplicate_names parameter to true in your deployment configuration. This parameter allows the deployment to proceed even if the pipeline name conflicts with an existing pipeline.

Re: Databricks Asset Bundle deploy failure

thibault — Mon, 21 Jul 2025 10:25:32 GMT

@Walter_C, should this property be set at the same level as name, catalog, channel? I'm getting an error at the schema validation (using the template from databricks bundle schema with databricls-cli v0.260.0), and the deployment does not succeed, due to the duplicated name error.
The intention was to replace the previous DLT with the new one, even though they're similar, only the run_as was changed.