I am also facing same issue , using Cluster

11.3 LTS (includes Apache Spark 3.3.0, Scala 2.12)

liberary : com.microsoft.azure:azure-eventhubs-spark_2.12:2.3.21

Please help me for same

conf = {}

conf["eventhubs.connectionString"] = "Endpoint=sb://xxxx.servicebus.windows.net/;SharedAccessKeyName=policyeh;SharedAccessKey=xxxx:=;EntityPath=xxxx "

read_df = (

 spark

  .readStream

  .format("eventhubs")

  .options(**conf)

  .load()

)

display(read_df)