https://community.databricks.com/t5/data-engineering/kafka-consumer-groups-in-databricks/m-p/5703#M2044 <P>Hi, we have a few examples on stream processing using Kafka (<A href="https://docs.databricks.com/structured-streaming/kafka.html" alt="https://docs.databricks.com/structured-streaming/kafka.html" target="_blank">https://docs.databricks.com/structured-streaming/kafka.html</A>), there is no straight public document for Kafka consumer group creation. You can refer to <A href="https://kafka.apache.org/documentation/" alt="https://kafka.apache.org/documentation/" target="_blank">https://kafka.apache.org/documentation/</A> on that. </P><P>Please let us know if this helps.&nbsp;</P><P>Also, please tag&nbsp;<A href="https://community.databricks.com/s/profile/0053f000000WWwvAAG" alt="https://community.databricks.com/s/profile/0053f000000WWwvAAG" target="_blank">@Debayan</A>​&nbsp;with your next response which will notify me. Thank you!</P> Tue, 18 Apr 2023 06:55:14 GMT Debayan 2023-04-18T06:55:14Z https://community.databricks.com/t5/data-engineering/kafka-consumer-groups-in-databricks/m-p/5702#M2043 <P>I was trying to find information about configuring the consumer groups for kafka stream in databricks. By doing so I want to parallelize the stream and load it into databricks tables. Does the databricks handle this internally? If we can configure the consumer groups explicitly, can you please share some code snippets related to that. Thank you</P> Mon, 17 Apr 2023 13:52:08 GMT https://community.databricks.com/t5/data-engineering/kafka-consumer-groups-in-databricks/m-p/5702#M2043 kris08 2023-04-17T13:52:08Z https://community.databricks.com/t5/data-engineering/kafka-consumer-groups-in-databricks/m-p/5703#M2044 <P>Hi, we have a few examples on stream processing using Kafka (<A href="https://docs.databricks.com/structured-streaming/kafka.html" alt="https://docs.databricks.com/structured-streaming/kafka.html" target="_blank">https://docs.databricks.com/structured-streaming/kafka.html</A>), there is no straight public document for Kafka consumer group creation. You can refer to <A href="https://kafka.apache.org/documentation/" alt="https://kafka.apache.org/documentation/" target="_blank">https://kafka.apache.org/documentation/</A> on that. </P><P>Please let us know if this helps.&nbsp;</P><P>Also, please tag&nbsp;<A href="https://community.databricks.com/s/profile/0053f000000WWwvAAG" alt="https://community.databricks.com/s/profile/0053f000000WWwvAAG" target="_blank">@Debayan</A>​&nbsp;with your next response which will notify me. Thank you!</P> Tue, 18 Apr 2023 06:55:14 GMT https://community.databricks.com/t5/data-engineering/kafka-consumer-groups-in-databricks/m-p/5703#M2044 Debayan 2023-04-18T06:55:14Z