Showing results for 
Search instead for 
Did you mean: 
Honored Contributor
Honored Contributor
since ‎05-02-2022

User Stats

  • 90 Posts
  • 9 Solutions
  • 34 Kudos given
  • 21 Kudos received

User Activity

Definitely configure job timeouts, and configure notifications. This will help you to identify slowness due to various factors. It is crucial to also investigate and fix the issue causing the slowness. The first step is to identify the problem. This ...
If you have a streaming job, you need to check the batch metrics to be able to understand the stream progress. However, here are some other suggestions which we can use to monitor a streaming job and be stuck in a "hung" state. Streaming Listeners sp...
If you use Databricks Jobs for your workloads, it is possible you might have run into a situation where you find your jobs to be in "hung" state. Before cancelling the job it is important to collect the thread dump as I described here to be able to f...
Sign Up Go to in the 2 steps box on the right hand side  Note - It is important to select the Personal use section in the above step. Sign In Enter your details here
If you observe a hung job, thread dumps are crucial to determine the root cause. Hence, it would be a good idea to collect the thread dumps before cancelling the hung job. Here are the Instructions to collect the Spark driver/executor thread dump:  ​...