cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Unable to write to Volume from DLT pipeline

melbourne
New Contributor III

Hi,

I've a DLT pipeline running in Unity Catalog, and one of the task is to write content into a file within volume.

I was able to write to file within volume using just PySpark, however when I do the same in DLT, I get an error:

OSError: [Errno 30] Read-only file system: '/Volumes'

Has anyone faced this issue?

2 REPLIES 2

-werners-
Esteemed Contributor III

It seems like a permission error.  Can you check if the managed identity has correct permissions to write to the volume?
DLT should be supported to write into volumes.

melbourne
New Contributor III

I checked all the privileges and it looks alright.

However, I figured out that DLT uses a shared cluster and using that files cannot be written into a Volume.