messages from event hub does not flow after a time

Jreco
Contributor

Hi Team,

I'm trying to build a Real-time solution using Databricks and Event hubs.

Something weird happens after a time that the process start.

At the begining the messages flow through the process as expected with this rate:

image 

please, note that the last updated time is 50Sec.

However, after a time, the messages don't flow:

imagePlease note that the last updated time is: 11 hours.

If I restart the job, the messages flow again as expected (even recovering the messages that does not were processed in the las 11 hours, for this case)

This is a graph of the example of the issue:

imageThe last peek was when I restarted the job.

Any idea what could happens?