cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

S3 bucket mount

Digan_Parikh
Valued Contributor

If you mount an S3 bucket using an AWS instance profile, does that mounted bucket become accessible to just that 1 cluster or to other clusters in that workspace as well?

1 ACCEPTED SOLUTION

Accepted Solutions

Digan_Parikh
Valued Contributor

Mounts are global to all clusters but as a best practice, you can use IAM roles to prevent access tot he underlying data.

To take this one step further, you can use IAM credential passthrough rather than instance profile because instance profile can be associated with only one IAM role so all users on the clusters have to share that role and the data policies of that role.

doc -https://docs.databricks.com/security/credential-passthrough/iam-passthrough.html

View solution in original post

1 REPLY 1

Digan_Parikh
Valued Contributor

Mounts are global to all clusters but as a best practice, you can use IAM roles to prevent access tot he underlying data.

To take this one step further, you can use IAM credential passthrough rather than instance profile because instance profile can be associated with only one IAM role so all users on the clusters have to share that role and the data policies of that role.

doc -https://docs.databricks.com/security/credential-passthrough/iam-passthrough.html

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.