Add an Instance Profile to a DLT job cluster

BradSheridan
Databricks Partner

@Tomasz Bacewicz​ I've got another, related question for you about the job cluster that is spun up for DLT jobs. Adding the JSON strings for our required E2 tags worked like a charm, but now I need to attach an existing Instance Profile since I'm trying to access our S3 buckets in my DLT job. I've looked online for how to do this in the JSON but no luck. thanks! Brad

tomasz
Databricks Employee
Databricks Employee

@Brad Sheridan​ To do that you have to add the aws_attributes tag within a cluster configuration and there you have the ability to add an instance_profile_arn like so:

"clusters": [

{

"label": "default",

"aws_attributes": {

"instance_profile_arn": "<REDACTED>"

},

I hope this helps!

View solution in original post

BradSheridan
Databricks Partner

Once again, THANK YOU! Worked like a charm