Databricks single user compute cannot write to storage

[jar]

I've deployed unrestricted single user compute for each developer in our dev workspace and everything works fine except for writing to storage where the cell will continuously run but seemingly not execute anything. If I switch to an unrestricted shared compute with the same runtime (16.1) then it works fine. Workspace is UC-enabled and writes to an ADLS Gen2 account. What could be the issue here?

[Alberto_Umana]

Hi @jar,

Single user mode takes the credentials of the owner of the cluster, do the users writing to the ADLS storage have required permissions to the storage?

[jar]

Hi @Alberto_Umana, and thank you for your reply. Yes, they have the Storage Blob Data Contributor role on the storage account.

[Alberto_Umana]

Hi @jar,

Thanks! How have you configured the ADLS with UC? as an external location, if so the users have permissions on it in Unity Catalog?

[jar]

Hi @Alberto_Umana.

Yes, as an external location. I myself cannot use the single user cluster to write data to storage (can easily read it though) and I have all privileges on the external location (container) I am trying to write to (including storage blob data contributor to the ADLS account).

[Alberto_Umana]

Hi @jar,

Thanks for your comments, so using the single mode cluster you are able to read the data on the external location but not write to it? also what are the permissions on Unity Catalog on the catalog.schema.table?