How to explain the huge time latency between two jobs? How to optimize the job to reduce the latency ?

dududu
Databricks Partner

‎04-25-2022 08:31 AM

I have met a problem , you can see in the picture as followed:

image 

there is some long delay between some jobs , I don't understand what happened and how to optimize the job ? Can anybody help me ? Thanks a lot.

Preview file
21 KB
0 Kudos

jose_gonzalez
Databricks Employee
Databricks Employee

‎07-25-2022 02:40 PM

Hi @jieping zhang​,

Did you check the driver's logs? do you see any error messages? please provide more details

0 Kudos