cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
NandiniN
Honored Contributor
Honored Contributor
since ‎05-02-2022
2 weeks ago

User Stats

  • 108 Posts
  • 11 Solutions
  • 43 Kudos given
  • 33 Kudos received

User Activity

How to deal with Slow Jobs?

06-01-2024
Definitely configure job timeouts, and configure notifications. This will help you to identify slowness due to various factors. It is crucial to also investigate and fix the issue causing the slowness. The first step is to identify the problem. This ...

Monitoring a Streaming Job

06-01-2024
If you have a streaming job, you need to check the batch metrics to be able to understand the stream progress. However, here are some other suggestions which we can use to monitor a streaming job and be stuck in a "hung" state. Streaming Listeners sp...

Why configure a job timeout?

06-01-2024
If you use Databricks Jobs for your workloads, it is possible you might have run into a situation where you find your jobs to be in "hung" state. Before cancelling the job it is important to collect the thread dump as I described here to be able to f...

Databricks Community Edition Login - Sign Up/Sign In/Forgot Password

06-01-2024
Sign Up Go to https://www.databricks.com/try-databricksFill in the 2 steps box on the right hand side  Note - It is important to select the Personal use section in the above step. Sign In Enter your details here https://accounts.cloud.databricks.com/...

How to collect a thread dump from Databricks Spark UI.

05-14-2024
If you observe a hung job, thread dumps are crucial to determine the root cause. Hence, it would be a good idea to collect the thread dumps before cancelling the hung job. Here are the Instructions to collect the Spark driver/executor thread dump:  ​...