topic Re: Reading csv file with spark throws [insufficient privelage] error in Get Started Discussions

Reading csv file with spark throws [insufficient privelage] error

chari — Fri, 19 Apr 2024 07:00:51 GMT

Hello Community,

I have some csv files saved in databricks workspace and want to read them with spark. I make use of the command

df = spark.read.format('csv').load(r'filepath')

However, it throws the error.

org.apache.spark.SparkSecurityException: [INSUFFICIENT_PERMISSIONS] Insufficient privileges:

I own these files as they reside in my workspace. Could you please help me to understand the cause

and a solution for the error ?

Thanks

Ajay-Pandey — Fri, 19 Apr 2024 08:02:11 GMT

Where you saved the files it in DBFS or an external location such as ADLS, S3 Also, please confirm if you have enabled UC on your workspace or not?

Lakshay — Fri, 19 Apr 2024 11:09:41 GMT

If this a UC enabled workspace, you need to provide the right access.