cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

How to configure Databricks Connect to 'Assume Role' when accessing file from an AWS S3 bucket?

lsoewito
New Contributor

I have a Databricks cluster configured with an instance profile to assume role when accessing an AWS S3 bucket.

Accessing the bucket from the notebook using the cluster works properly (the instance profile can assume role to access the bucket).

However, when accessing the same bucket via Databricks Connect with the same cluster doesn't work. It throws 'InvalidMountException' with message '403 Forbidden'.

1 ACCEPTED SOLUTION

Accepted Solutions

Kaniz
Community Manager
Community Manager

Hi @lsoewito​ , Here's how you can secure access to S3 buckets using instance profiles:-

Databricks Connect on High Concurrency clusters is available only in Databricks Runtime 7.3 LTS and above.

View solution in original post

3 REPLIES 3

Anonymous
Not applicable

Hello, @lsoewito​ - My name is Piper, and I'm a moderator for the Databricks community. Welcome and thank you for coming to us with your question. I'm sorry to hear that you're having trouble. Let's give your peers a chance to answer your question. We'll circle back if we need to. 🙂

Kaniz
Community Manager
Community Manager

Hi @lsoewito​ , Here's how you can secure access to S3 buckets using instance profiles:-

Databricks Connect on High Concurrency clusters is available only in Databricks Runtime 7.3 LTS and above.

Kaniz
Community Manager
Community Manager

Hi @lsoewito​ , We haven't heard from you since my last response, and I was checking back to see if my suggestions helped you. Or else, If you have any solution, please share it with the community as it can be helpful to others. Also, please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.