- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-21-2024 10:53 PM
"Looks like the issue is source is not able to reach" - Can you please let me know what you mean by this.
Libraries installed on the databricks cluster are as below, I have a cluster with14.2 version on which I have installed maven library(com.crealytics:spark-excel_2.12:3.5.0_0.20.3). We auto-terminate the cluster after say X - minutes of inactivity (JFYI).
Now the problem is when I try to import data from excel file I get this error intermittently i.e. not always. This was working always without any issues when I was using 13.2 version cluster. Since I have upgraded to 14.2 databricks cluster I'm seeing this error (org.apache.spark.SparkClassNotFoundException). Im using databricks-connect to import data from external sources.