i have submitted around 90 job at a time to databricks, the job was running continuously for 2 hours after that i am getting fatal error Pyhon kernel is unresponsive.
I am using Databricks runtime version : 11.2
Cluster Configuration Details are given below.
Worker type: standard_D32s_v3 128GB memory, 32 core
Driver type: standard_D32s_v3 128gb memory, 32 core
Please do needful. How can i resolve this issue.