How to provide access to user bases on the login credentials databricks

[User16826994223]

Hi Team

I am trying to do security audit and its become tough to manage so many credentials and IAM role we have in databricks Different clusters, Is it possible that I simplify it , like a user who has type of access in s3 bucket get same type of access if he /sh logins through databricks , in shot if a users ids to login databricks has access to s3 then he should be able to read and write , if that user id doesnot have access to bucket he should not able to read and write to s3 bucket

[User16826994223]

This is a great question and Databricks is working continuously working on management of security , to make user experience better and simple.

The use case you are trying to solve will be easily solved using high concurrency cluster and checking on IAM credential passthrough.

Link - https://docs.databricks.com/security/data-governance.html#iam-credential-passthrough

On the other hand a new feature is released called Unity Catalog that is in private preview that will make the all security auditing as well as it provide the secure gateway to every access.

https://databricks.com/product/unity-catalog