topic Re: unable to add new instance profile in Data Engineering

unable to add new instance profile

164079 — Thu, 10 Nov 2022 09:56:42 GMT

Hi team,

I want to start adding more instance profile per team . when adding it via TF , im getting the below error:

Im able BTW to add and change other databricks resources via TF .

This is my new code block:

The new role created by the TF but wasnt added to databricks, so i decided add it manually via my workspace console and im receiving the below error:

So i assume there is a general issue adding new instance profile to my workspace and its not related to a TF issue.

Please advise

Thanks!

Re: unable to add new instance profile

Vivian_Wilfred — Thu, 10 Nov 2022 11:28:07 GMT

Hi @Avi Edri ,

The error you see on terraform and the workspace console does not seem to be related.

For the console error:

Have you added iam:passRole permissions to the instance profile on your E2 policy? Check this doc-

https://docs.databricks.com/administration-guide/cloud-configurations/aws/instance-profiles.html#step-4-add-the-s3-iam-role-to-the-ec2-policy

For the terraform error:

Have you configured the databricks URL in the "host" parament while declaring the databricks provider? The databricks_instance_profile tf resource is looking for a workspace URL where it should create the instance profile. Authenticate the provider with the host and a PAT token and retry -

https://registry.terraform.io/providers/databricks/databricks/latest/docs#authenticating-with-hostname-and-token

Re: unable to add new instance profile

164079 — Thu, 10 Nov 2022 11:57:36 GMT

Thank you @Vivian Wilfred

You are so correct,

So regarding the console adding error, i added this iampass with my new role and i am able to add new instance profile via workspace console.

Regarding the TF ,I added the workspace provider and it is also works now. this is great.

I have one last question, I couldnt find the main iam policy attached to the cross account role on the databricks TF module ( same policy i added the iam pass with my new role. so i had to add those config manually. can you maybe tell me if i can control this policy via the TF?

And its called by the TF as: aws_iam_role_policy.this

but couldnt find it

Thanks!

Re: unable to add new instance profile

164079 — Thu, 10 Nov 2022 14:39:24 GMT

Thank you @Vivian Wilfred

all ok now, with the databricks console and the TF

Have a graet day!