https://community.databricks.com/t5/data-engineering/databaricks-cluster-issue/m-p/88710#M37592 <P>Jobs within the all purpose DB Cluster are failing with "<STRONG>the spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached</STRONG>"<BR /><BR />In the event log it says "Event_type=<STRONG>DRIVER_NOT_RESPONDING</STRONG> &amp; MESSAGE= "<STRONG>Driver is up but is not responsive, likely due to GC</STRONG>."</P><P>&nbsp;</P><P>Please help me to fix this.</P> Thu, 05 Sep 2024 11:47:15 GMT PKD28 2024-09-05T11:47:15Z https://community.databricks.com/t5/data-engineering/databaricks-cluster-issue/m-p/88710#M37592 <P>Jobs within the all purpose DB Cluster are failing with "<STRONG>the spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached</STRONG>"<BR /><BR />In the event log it says "Event_type=<STRONG>DRIVER_NOT_RESPONDING</STRONG> &amp; MESSAGE= "<STRONG>Driver is up but is not responsive, likely due to GC</STRONG>."</P><P>&nbsp;</P><P>Please help me to fix this.</P> Thu, 05 Sep 2024 11:47:15 GMT https://community.databricks.com/t5/data-engineering/databaricks-cluster-issue/m-p/88710#M37592 PKD28 2024-09-05T11:47:15Z https://community.databricks.com/t5/data-engineering/databaricks-cluster-issue/m-p/98331#M39697 <P><a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/119395">@PKD28</a>&nbsp;</P> <P>The error indicates that the driver memory is not enough to handle the load.<BR /><BR />Please refer to this doc for more info and on how to fix this<BR /><A href="https://kb.databricks.com/en_US/jobs/driver-unavailable" target="_blank">https://kb.databricks.com/en_US/jobs/driver-unavailable</A></P> Mon, 11 Nov 2024 13:10:40 GMT https://community.databricks.com/t5/data-engineering/databaricks-cluster-issue/m-p/98331#M39697 MuthuLakshmi 2024-11-11T13:10:40Z