https://community.databricks.com/t5/administration-architecture/troubleshooting-cluster/m-p/90956#M1844 <P>&nbsp;</P><P>We had a failure on a previously running fact table load (our biggest one) and it looked like an executor was failing due to a timeout error. As a test we upped the cluster size and changed the spark.executor.heartbeatinterval to 300s and the spark.network.timeout to 600s. However the particular job still fails (reporting a "Executor heartbeat timed out after XXXXX ms). Looking further in the logs we noted an error message with the code XXKDA with not a lot of other info. Looking into that error message the dbricks website suggests a bug report is in order, although not sure on that.</P><P>Anyone got anything else that we could check? or what the XXKDA error message could mean? We`re currently trying a remedial action of reducing the amount of data (it`s a large merge on a fact table).</P> Wed, 18 Sep 2024 18:24:10 GMT AndySkinner 2024-09-18T18:24:10Z https://community.databricks.com/t5/administration-architecture/troubleshooting-cluster/m-p/90956#M1844 <P>&nbsp;</P><P>We had a failure on a previously running fact table load (our biggest one) and it looked like an executor was failing due to a timeout error. As a test we upped the cluster size and changed the spark.executor.heartbeatinterval to 300s and the spark.network.timeout to 600s. However the particular job still fails (reporting a "Executor heartbeat timed out after XXXXX ms). Looking further in the logs we noted an error message with the code XXKDA with not a lot of other info. Looking into that error message the dbricks website suggests a bug report is in order, although not sure on that.</P><P>Anyone got anything else that we could check? or what the XXKDA error message could mean? We`re currently trying a remedial action of reducing the amount of data (it`s a large merge on a fact table).</P> Wed, 18 Sep 2024 18:24:10 GMT https://community.databricks.com/t5/administration-architecture/troubleshooting-cluster/m-p/90956#M1844 AndySkinner 2024-09-18T18:24:10Z https://community.databricks.com/t5/administration-architecture/troubleshooting-cluster/m-p/108685#M2935 <P>The XXKDA error code is a general indicator for task scheduler issues or <A href="https://github.com/apache/spark/blob/2581ca17eafca0d3f7dccfb3b7900474dab0969e/core/src/test/scala/org/apache/spark/JobCancellationSuite.scala#L213" target="_self">SPARK_JOB_CANCELLED</A>.</P> Tue, 04 Feb 2025 00:35:46 GMT https://community.databricks.com/t5/administration-architecture/troubleshooting-cluster/m-p/108685#M2935 Ismael-K 2025-02-04T00:35:46Z