Reading csv file with spark throws [insufficient privelage] error
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-19-2024 12:00 AM
Hello Community,
I have some csv files saved in databricks workspace and want to read them with spark. I make use of the command
df = spark.read.format('csv').load(r'filepath')
However, it throws the error.
org.apache.spark.SparkSecurityException: [INSUFFICIENT_PERMISSIONS] Insufficient privileges:
I own these files as they reside in my workspace. Could you please help me to understand the cause
and a solution for the error ?
Thanks