Reading csv file with spark throws [insufficient privelage] error
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-19-2024 12:00 AM
Hello Community,
I have some csv files saved in databricks workspace and want to read them with spark. I make use of the command
df = spark.read.format('csv').load(r'filepath')
However, it throws the error.
org.apache.spark.SparkSecurityException: [INSUFFICIENT_PERMISSIONS] Insufficient privileges:
I own these files as they reside in my workspace. Could you please help me to understand the cause
and a solution for the error ?
Thanks
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-19-2024 01:02 AM
Hi @chari
Where you saved the files it in DBFS or an external location such as ADLS, S3 Also, please confirm if you have enabled UC on your workspace or not?
Ajay Kumar Pandey
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-19-2024 04:09 AM
If this a UC enabled workspace, you need to provide the right access.
