cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Deploying using Databricks asset bundles (DABs) in a closed network

dbxlearner
New Contributor II

Hello, I'm trying to deploy DBX workflows using DABs using an Azure DevOps pipeline, in a network that cannot download the required terraform databricks provider package online, due to firewall/network restrictions.

I have followed this post: https://github.com/databricks/cli/issues/1238 on how to do this by providing the terraform databricks provider file locally, however, the terraform databricks provider version it's trying to use on the 'databricks bundle deploy' command (1.71.0) it is not matching my file version (1.50.0), hence I'm getting the following "Error: failed to query available provider packages, could not retrieve the list of available versions for provider databricks/databricks: no available releases match the given constrains 1.71.0".

I had a look at the bundle.tf.json file, that the databricks bundle deploy generates when using the deploy command and it is stating to use version 1.71.0, is there a way to set this to the version I want?

1 REPLY 1

dbxlearner
New Contributor II

Another thing I noticed is, when running the 'databricks bundle debug terraform' command, it mentions these variables:

dbxlearner_0-1748044088599.png

I have tried setting these variables as environment variables in my ADO pipeline, specially the databricks terraform provider variable, but it has not made any effect. If anyone has previously used these variables would appreciate if you can let me know how to set them properly.

 

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now