Hi All,
I'm facing an issue with my Spark Streaming Job. It gets stuck in the "Stream Initializing" phase for more than 3 hours.
Need your help here to understand what happens internally at the "Stream Initializing" phase of the Spark Streaming job that is taking so much time. Below are some more information -
1. This Streaming job(where we are facing an issue) reads data from the silver table and inserts it into the gold table.
2. silver table gets data from another streaming job from the raw table.
3. There is another Batch job that reads from silver and writes to gold(same functionality as a streaming job) that is working without any issue.