- 8372 Views
- 2 replies
- 0 kudos
Resolved! pass application.conf file into databricks jobs
i copied my question from an very old question/post that i reponded. and decided to move it to here:context:I have jar (scala), using scala pureconfig (wrapper of typesafe config)uploaded an application.conf file to a path which is mounted to the wor...
- 8372 Views
- 2 replies
- 0 kudos
- 0 kudos
we had to put the conf in the root folder of the mounted path, and that works.maybe the mounted storage account being blob instead of adls2 is causing the issues.
- 0 kudos
- 15289 Views
- 3 replies
- 1 kudos
Job is fails with java.lang.NoClassDefFoundError: Could not initialize class error
hi,It is scala code where we are connecting Redis to store (sparkcontext.toRedisKV) and i am also using scala udf . ihave excuted the same code in notebook without scala object and it works fine but everytime it fails when i am using same code in jar...
- 15289 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Satish Kumbhar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 1 kudos
- 3720 Views
- 0 replies
- 0 kudos
How to resolve "java.lang.ClassNotFoundException: com.databricks.spark.util.RegexBasedAWSSecretKeyRedactor" when running Scala Spark project using databricks-connect ?
Currently I am learning how to use databricks-connect to develop Scala code using IDE (VS Code) locally. The set-up of the databricks-connect as described here https://docs.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect was succues...
- 3720 Views
- 0 replies
- 0 kudos