Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-09-2021 08:25 AM
In addition to previous message, I am now able to run properly the job using Redshift driver from Databricks job: just add the Redshift library and the JAR for the job and it works.
However, not very convenient for debugging.
When I tried to run the app from Intellij to the remote Databricks cluster issue : Exception in thread "main" java.lang.ClassNotFoundException: Could not load an Amazon Redshift JDBC driver; see the README for instructions on downloading and configuring the official Amazon driver.
Tried :
- to add the driver JAR into Databricks connect jar path : no success
- use sc.addJars : no success
- use sc.addJars with dbfs path of the driver : no success
Is there a way to run in debug mode Scala app in Databricks cluster or not ?
Thank you