Fatal error: Python kernel is unresponsive

dhanu
New Contributor

i have submitted around 90 job at a time to databricks, the job was running continuously for 2 hours after that i am getting fatal error Pyhon kernel is unresponsive.

I am using Databricks runtime version : 11.2

Cluster Configuration Details are given below.

Worker type: standard_D32s_v3 128GB memory, 32 core

Driver type: standard_D32s_v3 128gb memory, 32 core

Please do needful. How can i resolve this issue.

Lakshay
Databricks Employee
Databricks Employee

please try using this configuration:

spark.databricks.python.defaultPythonRepl pythonshell

jose_gonzalez
Databricks Employee
Databricks Employee

Hi @Dhanaraj Jogihalli​,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.