topic Re: How do I use the azure databricks dlt pipeline to consume azure Event Center data in Data Engineering https://community.databricks.com/t5/data-engineering/how-do-i-use-the-azure-databricks-dlt-pipeline-to-consume-azure/m-p/112123#M44115 <P>Hi there&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/103629">@zmsoft</a>&nbsp;,<BR /><BR />Did you have a look at this ref doc :&nbsp;<A href="https://docs.databricks.com/aws/en/dlt/event-hubs" target="_blank">https://docs.databricks.com/aws/en/dlt/event-hubs</A><BR />This might help</P> Mon, 10 Mar 2025 05:28:15 GMT ashraf1395 2025-03-10T05:28:15Z How do I use the azure databricks dlt pipeline to consume azure Event Center data https://community.databricks.com/t5/data-engineering/how-do-i-use-the-azure-databricks-dlt-pipeline-to-consume-azure/m-p/112122#M44114 <P>Hi there, How do I use the azure databricks dlt pipeline to consume azure Event Hub data</P><P>Code :</P><LI-CODE lang="python">TOPIC = "myeventhub" KAFKA_BROKER = "" GROUP_ID = "group_dev" raw_kafka_events = (spark.readStream .format("kafka") .option("subscribe", EH_NAME) .option("kafka.bootstrap.servers", KAFKA_BROKER) .option("kafka.group.id", GROUP_ID) # Set Kafka consumer group ID .option("kafka.security.protocol", "SASL_SSL") .option("kafka.sasl.jaas.config", f"kafkashaded.org.apache.kafka.common.security.plain.PlainLoginModule required username=\"$ConnectionString\" password=\"{EH_CONN_STR}\";") # .option("kafka.ssl.endpoint.identification.algorithm", "https") # .option("kafka.sasl.mechanism", "PLAIN") .option("failOnDataLoss", "false") .option("startingOffsets", "earliest") .load() ) parsed_data = raw_kafka_events.select(col("value").cast("string")).alias("event") display(parsed_data) </LI-CODE><P>Error log:&nbsp;</P><LI-CODE lang="markup">kafkashaded.org.apache.kafka.common.KafkaException: Failed to create new KafkaAdminClient Caused by: kafkashaded.org.apache.kafka.common.KafkaException: java.lang.IllegalArgumentException: No serviceName defined in either JAAS or Kafka config at kafkashaded.org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:184) at kafkashaded.org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:192) at kafkashaded.org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:81) at kafkashaded.org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:105) at kafkashaded.org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:522)</LI-CODE><P>&nbsp;</P><P>Thanks&amp;Regards, zmsoft</P> Mon, 10 Mar 2025 05:06:12 GMT https://community.databricks.com/t5/data-engineering/how-do-i-use-the-azure-databricks-dlt-pipeline-to-consume-azure/m-p/112122#M44114 zmsoft 2025-03-10T05:06:12Z Re: How do I use the azure databricks dlt pipeline to consume azure Event Center data https://community.databricks.com/t5/data-engineering/how-do-i-use-the-azure-databricks-dlt-pipeline-to-consume-azure/m-p/112123#M44115 <P>Hi there&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/103629">@zmsoft</a>&nbsp;,<BR /><BR />Did you have a look at this ref doc :&nbsp;<A href="https://docs.databricks.com/aws/en/dlt/event-hubs" target="_blank">https://docs.databricks.com/aws/en/dlt/event-hubs</A><BR />This might help</P> Mon, 10 Mar 2025 05:28:15 GMT https://community.databricks.com/t5/data-engineering/how-do-i-use-the-azure-databricks-dlt-pipeline-to-consume-azure/m-p/112123#M44115 ashraf1395 2025-03-10T05:28:15Z