cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

DABs job name must start with a letter or underscore

maikl
New Contributor III

Hi,

In UI I used the pipeline name 00101_source_bronze. I wanted to do the same in the Databricks Asset Bundles.

maikl_0-1733912307017.png

but when the configuration is refreshed against Databricks Workspace I see this error:

maikl_1-1733912509922.png

I found that this issue can be connect to Terraform version 1.6.5 - 1.7.x. (https://github.com/hashicorp/terraform/issues/34786)

Is possible somehow to update the Terraform version?

I am using the Databricks CLI version 0.235

Thank you.

 

#databricks asset bundles

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Walter_C
Databricks Employee
Databricks Employee

As mentioned above, this is a limitation directly with Terraform due to this our engineering team is limited on the actions that can be done, you can find more information about this limitation on the Terraform documentation: https://developer.hashicorp.com/terraform/language/resources/syntax#:~:text=letter%20or%20underscore 

 

View solution in original post

4 REPLIES 4

Walter_C
Databricks Employee
Databricks Employee

We are aware of this situation, as per our engineering team this is more a limitation as of now with terraform and not specifically to the Databricks provider, as you have mentioned as of now you might need to start the name with a letter or the underscore.

maikl
New Contributor III

When the limitation is with Terraform, can we use our version of Terraform, like 1.9.5? Save the terraform file into any folder within the bundle folder structure.

If it's impossible, when is the engineering team planning to fix this problem/limitation?

We are considering migrating the Synapse pipelines to Databricks Workflow and using the Asset Bundles.

Thank you.

Walter_C
Databricks Employee
Databricks Employee

As mentioned above, this is a limitation directly with Terraform due to this our engineering team is limited on the actions that can be done, you can find more information about this limitation on the Terraform documentation: https://developer.hashicorp.com/terraform/language/resources/syntax#:~:text=letter%20or%20underscore 

 

maikl
New Contributor III

I understood it.

Thank you.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group