shyam_9
Databricks Employee
Databricks Employee

Hi @Raymond_Hu,

This means that the driver crashed because of an OOM (Out of memory) exception and after that, it's not able to establish a new connection with the driver. Please try below options

  • Try increasing driver-side memory and then retry.
  • You can look at the spark job dag which give you more info on data flow.