Some streams terminated before this command could finish! -> java.lang.NoClassDefFoundError: scala/c

[lakime]

Hello

I do face:

Some streams terminated before this command could finish!

java.lang.NoClassDefFoundError: scala/compat/java8/FutureConverters$

Running some very simple query on eventhub :

df = spark \

.readStream \

.format("eventhubs") \

.options(**ehConf) \

.load()

query = df \

.writeStream \

.outputMode("append") \

.format("console") \

.start()

My current setup is Runtime 13.3 LTS (Scala 2.12, Spark 3.4.1)

com.microsoft.azure:azure-eventhubs:3.2.2

azure_eventhubs_spark_2_12_2_3_17.jar (manually installed)

I have tried different versions (mostly Runtime and eventhubs spark) - but it is still failing ...

Can someone point me to proper set-up of version to have that working ? 

[lakime · Accepted solution]

Of course just after writing that post I did realized how dummy this question is .... after adding scala_java8_compat_2_12_1_0_2.jar it works as expected

[Kaniz_Fatma]

Hi @lakime , I want to express my gratitude for your effort in selecting the most suitable solution. It's great to hear that your query has been successfully resolved. Thank you for your contribution.