NandiniN
Databricks Employee
Databricks Employee

I believe you are not setting 

spark.conf.set("/Volumes/[PATH]", "your_actual_path_here")

hence when you try to get the conf, it fails. 

data_source_path = spark.conf.get("/Volumes/[PATH]")

"/Volumes/[PATH]" becomes the conf name, you would not want to name it with / and [] rather like read_path.