User not authorised to copy files to dbfs

curiousoctopus — Wed, 20 Mar 2024 11:19:36 GMT

Hi,

I'm trying to use a service principal to copy files to dbfs using the command line "databricks fs cp <source> <target>" but get back "User not authorised". I configured the authentication with PAT token and it is successful as I can deploy and launch jobs. My service principal is in a group with the following entitlements:

- Workspace access

- Databricks SQL access

- Allow unrestricted cluster creation

- allow-instance-pool-create

What permissions am I missing to copy files to dbfs?

Re: User not authorised to copy files to dbfs

Walter_C — Thu, 21 Mar 2024 16:52:55 GMT

In Databricks, data access permissions are often managed separately from workspace permissions. For DBFS, access control is typically managed through the underlying cloud storage (Azure Blob Storage, S3, etc.). The service principal needs to have the necessary permissions on the underlying storage to read, write, or delete data.

topic User not authorised to copy files to dbfs in Administration & Architecture

User not authorised to copy files to dbfs

Re: User not authorised to copy files to dbfs