cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

java.lang.NoSuchMethodError in databricks

sarvesh242
Contributor

I have created a package in scala. Now, I am calling a method from that package and using it in my notebook. During run time, it throws me an error java.lang.NoSuchMethodError. The method exists in the package but still, I am getting this error. Please guide me regarding the same.

1 ACCEPTED SOLUTION

Accepted Solutions

sarvesh242
Contributor

Hi! @Kaniz Fatma​ . I am using scala version 2.11 with spark 2.4.3.

According to Apache spark official website 😞https://spark.apache.org/docs/2.4.3/#:~:text=For%20the%20Scala%20API%2C%20Spark,x.)

Spark 2.4.3 uses Scala 2.12.

(https://spark.apache.org/docs/2.4.0/#:~:text=For%20the%20Scala%20API%2C%20Spark,0%20uses%20Scala%202....)

 Spark 2.4. 0 uses Scala 2.11.

I have two options with respect to Spark/scala version. Does any option has edge over the other ?

Thanks!

View solution in original post

3 REPLIES 3

sarvesh242
Contributor

scala version 2.11 with spark 2.4.3

sarvesh242
Contributor

Hi! @Kaniz Fatma​ . I am using dependencies for scala 2.11. Can you please elaborate on the above point

"mixing different scala versions".

Thanks

sarvesh242
Contributor

Hi! @Kaniz Fatma​ . I am using scala version 2.11 with spark 2.4.3.

According to Apache spark official website 😞https://spark.apache.org/docs/2.4.3/#:~:text=For%20the%20Scala%20API%2C%20Spark,x.)

Spark 2.4.3 uses Scala 2.12.

(https://spark.apache.org/docs/2.4.0/#:~:text=For%20the%20Scala%20API%2C%20Spark,0%20uses%20Scala%202....)

 Spark 2.4. 0 uses Scala 2.11.

I have two options with respect to Spark/scala version. Does any option has edge over the other ?

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group