cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Azure Databricks - Terraform errors while using workspace level provider

Terraformuser
New Contributor

Hello All,

I have a question about deploying Azure Databricks with Terraform. Does Databricks have any API call limits? I can deploy external location, a storage credential and it's tested and confirmed working. But when i try to deploy 2 additional external locations and storage credentials i run into an error in Terraform: "Unauthorized access to workspace". When I limit deployment to 1 external location it works. Then when I have 2 or 3 external locations and I run Terraform plan, while Terraform is checking the actual resources to compare with the state file I get "Unauthorized access to workspace" again. All external locations use the same workspace as provider and external location can only be deployed with a workspace level provider.

Sometimes without any changes terraform plan runs successfully, but then when I run terraform apply which runs plan again the error pops up again with unauthorized access. Did anybody have this issue?

 

1 REPLY 1

Alberto_Umana
Databricks Employee
Databricks Employee

Hello @Terraformuser,

Could you try to enable debug on while applying your terraform, that would give you more context on the failure.

TF_LOG=DEBUG DATABRICKS_DEBUG_TRUNCATE_BYTES=250000 terraform apply -no-color 2>&1 |tee tf-debug.log

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group