Databricks Bundle Deployment Question

leandro09 — Wed, 14 May 2025 16:24:09 GMT

Hello, everyone! I’ve been working on deploying Databricks bundles using Terraform, and I’ve encountered an issue. During the deployment, the Terraform state file seems to reference resources tied to another user, which causes permission errors.

I’ve checked all my project files, including deployment.yml, and there are no visible references to the other user. I’ve also tried cleaning up the local terraform.tfstate file and .databricks folder, but the issue persists.

Is this a common problem when using Terraform for Databricks deployments? Could it be related to some hidden cache or residual state?

does not have Admin or Manage Run or Owner or View permissions on job 22955771686345

with databricks_job.RunBatch,
on bundle.tf.json line 234, in resource.databricks_job.RunBatch:
234: },

Any insights or suggestions would be greatly appreciated. Thanks!

Re: Databricks Bundle Deployment Question

Isi — Sat, 17 May 2025 18:57:15 GMT

Hey @leandro09 ,

My opinion this kind of error is often related to Terraform state still tracking a resource that was created or managed by another user, and your current user doesn’t have permissions to update or read it.

terraform state list

This will show you all resources currently tracked by Terraform. If you see something like databricks_job.RunBatch, it’s likely still being managed, even if it’s not present in your .tf files.

Also you could pull and inspect the full state file:

terraform state pull > log.json

If you confirm that the job is in the state but shouldn’t be, you can remove it with:

#Example terraform state rm databricks_job.RunBatch

Hope this helps, 🙂

Isi

topic Databricks Bundle Deployment Question in Get Started Discussions

Databricks Bundle Deployment Question

Re: Databricks Bundle Deployment Question