topic Re: dbfs /mounts permissions with Clusters on Shared Mode / Serverless in Data Engineering

dbfs /mounts permissions with Clusters on Shared Mode / Serverless

RobsonNLPT — Fri, 26 Jul 2024 11:06:28 GMT

Hi all

I've used mounts based on service principals but users using shaed clusters or the new serverless they have problems with permissions to access resources on dbfs. Right now we have used clusters in single mode

What should be the best approach to grant permissions to users on dbfs using shared clusters?

I think using service principal to create mounts and something using control access list on the top to assign permission at different levels could be a good approach. This way we prevent to the dbfs on behalf service principals

Re: dbfs /mounts permissions with Clusters on Shared Mode / Serverless

RobsonNLPT — Tue, 30 Jul 2024 11:50:45 GMT

In this case I'm not using tables . Its about mounting on adls gen 2 raw files

Re: dbfs /mounts permissions with Clusters on Shared Mode / Serverless

RobsonNLPT — Tue, 30 Jul 2024 11:52:06 GMT

Maybe volumes could be a good solution