How to read data from kafka topic using spark streaming

[scholar]

I have installed kafka-2.10-0.10.2.

And using cluster with configuration: Runtime :6.4 Extended Support( scala 2.11,Spark 2.4.5)

After this i am able to get mesgage son producer and consumer

But when i try to read data from spark.readsttream and try to write it on console. It doesnot show any response. Even dont give any error

Attaching the sccreenshot of the issue

Here i dnt get any response even.. i check in driver logs tooo

Open to all suggeztion

[Hubert-Dudek]

You can just use display(orders_df3) for debugging purposes

[scholar]

I tried this too. It also not working for me

Do we need to add any jar or library to run this

[jose_gonzalez]

What is the error message you are getting? could you share more details please

[Kaniz · Accepted solution]

Hi @shreyshi Gupta​ ,

• Please go through this documentation from Databricks to explain how you can perform complex streaming analytics using Apache Spark™. Specifically, you can go through the below topics.

1. Reading Records from Kafka topics.
2. Using Spark as a Kafka Producer

• Also, here, you find a Spark Streaming example using rate source and console sink.

Please reach out to me if you have any issues while resolving your query.

[Kaniz]

Hi @shreyshi Gupta​ , We haven’t heard from you on the last response from me, and I was checking back to see if you have a resolution yet. If you have any solution, please share it with the community as it can be helpful to others. Otherwise, we will respond with more details and try to help.