04-12-2022 01:07 AM
I have created a package in scala. Now, I am calling a method from that package and using it in my notebook. During run time, it throws me an error java.lang.NoSuchMethodError. The method exists in the package but still, I am getting this error. Please guide me regarding the same.
04-14-2022 06:45 AM
Hi! @Kaniz Fatma . I am using scala version 2.11 with spark 2.4.3.
According to Apache spark official website 😞https://spark.apache.org/docs/2.4.3/#:~:text=For%20the%20Scala%20API%2C%20Spark,x.)
Spark 2.4.3 uses Scala 2.12.
Spark 2.4. 0 uses Scala 2.11.
I have two options with respect to Spark/scala version. Does any option has edge over the other ?
Thanks!
04-13-2022 01:45 AM
Hi @sarvesh gakhar , Can you please check the scala version?
04-13-2022 01:48 AM
scala version 2.11 with spark 2.4.3
04-13-2022 01:54 AM
Hi @sarvesh gakhar , The exception often arises if you mix different scala versions. Do you have any dependencies loaded for scala 2.11?
Please check if you have some libraries installed on your cluster that probably used Scala 2.11.
04-13-2022 04:51 AM
Hi! @Kaniz Fatma . I am using dependencies for scala 2.11. Can you please elaborate on the above point
"mixing different scala versions".
Thanks
04-13-2022 11:56 AM
Hi @sarvesh gakhar , I meant Spark and Scala version mismatch.
04-14-2022 06:45 AM
Hi! @Kaniz Fatma . I am using scala version 2.11 with spark 2.4.3.
According to Apache spark official website 😞https://spark.apache.org/docs/2.4.3/#:~:text=For%20the%20Scala%20API%2C%20Spark,x.)
Spark 2.4.3 uses Scala 2.12.
Spark 2.4. 0 uses Scala 2.11.
I have two options with respect to Spark/scala version. Does any option has edge over the other ?
Thanks!
04-26-2022 03:52 AM
@sarvesh gakhar , Just a friendly follow-up. Do you still need help? Please let us know.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group