cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

java.lang.NoSuchMethodError in databricks

sarvesh242
Contributor

I have created a package in scala. Now, I am calling a method from that package and using it in my notebook. During run time, it throws me an error java.lang.NoSuchMethodError. The method exists in the package but still, I am getting this error. Please guide me regarding the same.

1 ACCEPTED SOLUTION

Accepted Solutions

sarvesh242
Contributor

Hi! @Kaniz Fatma​ . I am using scala version 2.11 with spark 2.4.3.

According to Apache spark official website 😞https://spark.apache.org/docs/2.4.3/#:~:text=For%20the%20Scala%20API%2C%20Spark,x.)

Spark 2.4.3 uses Scala 2.12.

(https://spark.apache.org/docs/2.4.0/#:~:text=For%20the%20Scala%20API%2C%20Spark,0%20uses%20Scala%202....)

 Spark 2.4. 0 uses Scala 2.11.

I have two options with respect to Spark/scala version. Does any option has edge over the other ?

Thanks!

View solution in original post

7 REPLIES 7

Kaniz
Community Manager
Community Manager

Hi @sarvesh gakhar​ , Can you please check the scala version?

sarvesh242
Contributor

scala version 2.11 with spark 2.4.3

Kaniz
Community Manager
Community Manager

Hi @sarvesh gakhar​ , The exception often arises if you mix different scala versions. Do you have any dependencies loaded for scala 2.11?

Please check if you have some libraries installed on your cluster that probably used Scala 2.11.

sarvesh242
Contributor

Hi! @Kaniz Fatma​ . I am using dependencies for scala 2.11. Can you please elaborate on the above point

"mixing different scala versions".

Thanks

Kaniz
Community Manager
Community Manager

Hi @sarvesh gakhar​ , I meant Spark and Scala version mismatch.

sarvesh242
Contributor

Hi! @Kaniz Fatma​ . I am using scala version 2.11 with spark 2.4.3.

According to Apache spark official website 😞https://spark.apache.org/docs/2.4.3/#:~:text=For%20the%20Scala%20API%2C%20Spark,x.)

Spark 2.4.3 uses Scala 2.12.

(https://spark.apache.org/docs/2.4.0/#:~:text=For%20the%20Scala%20API%2C%20Spark,0%20uses%20Scala%202....)

 Spark 2.4. 0 uses Scala 2.11.

I have two options with respect to Spark/scala version. Does any option has edge over the other ?

Thanks!

Kaniz
Community Manager
Community Manager

@sarvesh gakhar​ , Just a friendly follow-up. Do you still need help? Please let us know.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.