topic Re: Terraform keep show changes for databricks_sql_permissions on plan and apply in Data Engineering

Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Tue, 06 Dec 2022 15:00:23 GMT

Hi team,

A very weird behaviour when using databricks_sql_permissions with terraform, the changes keep repeating to show on plan and apply.

Its repeating also after i apply the changes...

Please advise.

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

Vivian_Wilfred — Tue, 06 Dec 2022 16:00:07 GMT

Hi @Avi Edri , What is the terraform version and databricks provider version that you are using? Looks like it is related to the issue reported here

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

Pat — Tue, 06 Dec 2022 23:01:06 GMT

Hi @Avi Edri ,

I can see from the screen that you are using id = "any file/", it seems to be related to the import:

https://registry.terraform.io/providers/databricks/databricks/0.5.3/docs/resources/sql_permissions#import

can you try the below:

resource "databricks_sql_permissions" "any_file" {
  any_file = true
 
  privilege_assignments {
    principal  = "group-name"
    privileges = ["SELECT"]
  }
 
 privilege_assignments {
    principal  = "group-name2"
    privileges = ["MODIFY", "SELECT"]
  }
 
}

source: https://registry.terraform.io/providers/databricks/databricks/0.5.3/docs/resources/sql_permissions#argument-reference

You can also share your terraform code.

thanks,

Pat

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Wed, 07 Dec 2022 07:09:12 GMT

Hi @Vivian Wilfred

Yes its look like as a same issue.

My terraform version is: terraform-1.0.11

databricks provider:

provider "databricks" {

alias = "mws"

host = "https://accounts.cloud.databricks.com"

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Wed, 07 Dec 2022 07:11:00 GMT

Hi @Pat Sienkiewicz

Its already as you mention in my code, looks like on plan its adding this /

from my code:

resource "databricks_sql_permissions" "data_any_file" {

any_file = true

privilege_assignments {

principal = "EC - DATA"

privileges = ["SELECT", "MODIFY"]

}

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

Pat — Wed, 07 Dec 2022 07:16:22 GMT

Hi @Avi Edri ,

so maybe it's good, no? You will replace this way your existing privileges.

I mean that you probably had different privilege_assigments previously, now you have only:

privilege_assignments {

principal = "EC - DATA"

privileges = ["SELECT", "MODIFY"]

}

"any file /" might be good I think now, it's just a representation of the resource, you can forget about that part.

thanks,

Pat.

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

Pat — Wed, 07 Dec 2022 07:17:58 GMT

I am not sure about this, what is your databricks provider version, is it 1.6.3+?

it looks like you are changing permissions, hence why there is an update.

"EC - data" group is new permission and other groups will loose permissions.

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

Pat — Wed, 07 Dec 2022 07:19:52 GMT

to identify this you can do

terraform state show 'databricks_sql_permissions.data_any_file'

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Wed, 07 Dec 2022 07:29:21 GMT

correct, im using diffrent resource terraform names in order to make it uniqe assignment for diffrent principals.

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Wed, 07 Dec 2022 07:31:04 GMT

Yes, my databricks provider is 1.6.5

This is why its so weird, those changes on plan keep coming back even after apply them several times.

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

Pat — Wed, 07 Dec 2022 07:36:23 GMT

I am not sure if I understand this correctly, but what you need to do is set privileges in one terraform resource, otherwise they will get overwritten, meaning you should do:

resource "databricks_sql_permissions" "any_file" {
any_file = true
 
 
privilege_assignments {
principal = "EC - DATA"
privileges = ["SELECT", "MODIFY"]
}
 
privilege_assignments {
principal = "SOME_OTHER- DATA"
privileges = ["SELECT"]
}
 
 
}

not:

resource "databricks_sql_permissions" "ec_data_any_file" {
any_file = true
 
 
privilege_assignments {
principal = "EC - DATA"
privileges = ["SELECT", "MODIFY"]
}
 
}
 
resource "databricks_sql_permissions" "some_other_data_any_file" {
any_file = true
 
privilege_assignments {
principal = "SOME_OTHER- DATA"
privileges = ["SELECT"]
}
 
}

source: https://registry.terraform.io/providers/databricks/databricks/1.6.5/docs/resources/sql_permissions#argument-reference

You must specify one or many

privilege_assignments

configuration blocks to declare

privileges

to a

principal

, which corresponds to

display_name

of databricks_group or databricks_user. Terraform would ensure that only those principals and privileges defined in the resource are applied for the data object and would remove anything else.

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Wed, 07 Dec 2022 07:38:37 GMT

Ohh I see,

Let me try this

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Wed, 07 Dec 2022 08:11:30 GMT

Thanks @Pat Sienkiewicz

You are correct, i organize them all under on resource and no plan repetitions!

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

Pat — Wed, 07 Dec 2022 08:14:32 GMT

I am glad I could help, I've been there having similar issue with some other permissions 🙂

Re: Terraform keep show changes for databricks_sql_permissions on plan and apply

164079 — Wed, 07 Dec 2022 08:15:41 GMT

Yess!

Appreciate that mate!

Have a great day