Hi, I have several streaming jobs, however one of them uses the Trigger.AvailableNow. The issue is that it gets stuck when there is no events or finishes ingesting all events. The expected behavior would be the job being shutdown.

I've already checked and there is no new messages in my SQS Queue.

I'm using scala and cluster 12.2 LTS

Driver: Standard_DS3_v2 · Workers: Standard_D8s_v3 · 2-8 workers · 12.2 LTS (includes Apache Spark 3.3.2, Scala 2.12)

Has anyone seen this before?