Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-09-2025 03:52 AM
I believe you are not setting
spark.conf.set("/Volumes/[PATH]", "your_actual_path_here")
hence when you try to get the conf, it fails.
data_source_path = spark.conf.get("/Volumes/[PATH]")
"/Volumes/[PATH]" becomes the conf name, you would not want to name it with / and [] rather like read_path.