Hi @Kaniz Fatma​ ,

  1. Restarting the cluster after installation does not help.
  2. Anything is compatible. JAR file downloaded from https://mvnrepository.com/artifact/com.microsoft.azure/azure-eventhubs-spark_2.12/2.3.22. PySpark Version :3.3.0. Cluster Runtime11.3.x-scala2.12

With only (1) one installed, it is not working. With (1) and (2) installed, everything is working.

2023-03-02 14_04_00-Window