https://community.databricks.com/t5/data-engineering/can-i-connect-to-eventhub-using-kafka-api-which-is-the-preferred/m-p/20792#M14080 <P>Yes, it's possible to use Kafka API to connect to the eventhub. Eventhub supports the usage of Kafka API to stream the data from the Eventhub</P><P></P><P>Reference: </P><P><A href="https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-for-kafka-ecosystem-overview" target="test_blank">https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-for-kafka-ecosystem-overview</A></P><P></P><P>Sample program:</P><PRE><CODE>%python &nbsp; eh_sasl = 'kafkashaded.org.apache.kafka.common.security.plain.PlainLoginModule required username="$ConnectionString" password="Endpoint=sb://myazure-train-eventhub.us.servicebus.windows.net/;SharedAccessKeyName=manage-policy;SharedAccessKey=xxxxxXXXXXXXXX/xxxxxxx;'; &nbsp; inputStream = spark.readStream \ .format("kafka") \ .option("subscribe", "dataabricks-stream-event") \ .option("kafka.bootstrap.servers", "azure-training-us.servicebus.windows.net:9093") \ .option("kafka.sasl.mechanism", "PLAIN") \ .option("startingOffsets","earliest") \ .option("kafka.security.protocol", "SASL_SSL") \ .option("kafka.sasl.jaas.config", eh_sasl) \ .option("kafka.request.timeout.ms", "60000") \ .option("kafka.session.timeout.ms", "30000") \ .option("failOnDataLoss", "false") \ .load()</CODE></PRE><P></P> Thu, 24 Jun 2021 06:56:37 GMT brickster_2018 2021-06-24T06:56:37Z https://community.databricks.com/t5/data-engineering/can-i-connect-to-eventhub-using-kafka-api-which-is-the-preferred/m-p/20791#M14079 Thu, 24 Jun 2021 06:38:23 GMT https://community.databricks.com/t5/data-engineering/can-i-connect-to-eventhub-using-kafka-api-which-is-the-preferred/m-p/20791#M14079 brickster_2018 2021-06-24T06:38:23Z https://community.databricks.com/t5/data-engineering/can-i-connect-to-eventhub-using-kafka-api-which-is-the-preferred/m-p/20792#M14080 <P>Yes, it's possible to use Kafka API to connect to the eventhub. Eventhub supports the usage of Kafka API to stream the data from the Eventhub</P><P></P><P>Reference: </P><P><A href="https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-for-kafka-ecosystem-overview" target="test_blank">https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-for-kafka-ecosystem-overview</A></P><P></P><P>Sample program:</P><PRE><CODE>%python &nbsp; eh_sasl = 'kafkashaded.org.apache.kafka.common.security.plain.PlainLoginModule required username="$ConnectionString" password="Endpoint=sb://myazure-train-eventhub.us.servicebus.windows.net/;SharedAccessKeyName=manage-policy;SharedAccessKey=xxxxxXXXXXXXXX/xxxxxxx;'; &nbsp; inputStream = spark.readStream \ .format("kafka") \ .option("subscribe", "dataabricks-stream-event") \ .option("kafka.bootstrap.servers", "azure-training-us.servicebus.windows.net:9093") \ .option("kafka.sasl.mechanism", "PLAIN") \ .option("startingOffsets","earliest") \ .option("kafka.security.protocol", "SASL_SSL") \ .option("kafka.sasl.jaas.config", eh_sasl) \ .option("kafka.request.timeout.ms", "60000") \ .option("kafka.session.timeout.ms", "30000") \ .option("failOnDataLoss", "false") \ .load()</CODE></PRE><P></P> Thu, 24 Jun 2021 06:56:37 GMT https://community.databricks.com/t5/data-engineering/can-i-connect-to-eventhub-using-kafka-api-which-is-the-preferred/m-p/20792#M14080 brickster_2018 2021-06-24T06:56:37Z