topic Re: What will happen if a driver or worker node fails? in Data Engineering https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16430#M10616 <P>Good one @Cedric Law Hing Ping​&nbsp;</P> Tue, 28 Jun 2022 14:43:07 GMT Prabakar 2022-06-28T14:43:07Z What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16427#M10613 <P>What will happen if a driver node will fail?</P><P>What will happen if one of the worker node fails?</P><P>Is it same in Spark and Databricks or Databricks provide additional features to overcome these situations?</P> Tue, 28 Jun 2022 13:23:06 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16427#M10613 abd 2022-06-28T13:23:06Z Re: What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16428#M10614 <UL><LI>a worker is not a problem as it is RDD, so the dataset will survive on other workers, and new workers will be automatically deployed in databricks,</LI><LI>a driver is critical as without a driver whole cluster will fail (that's why you shouldn't use spot instances for the driver, but for workers is not a problem)</LI></UL> Tue, 28 Jun 2022 13:46:20 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16428#M10614 Hubert-Dudek 2022-06-28T13:46:20Z Re: What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16429#M10615 <P>If the driver node fails your cluster will fail. If the worker node fails, Databricks will spawn a new worker node to replace the failed node and resumes the workload. Generally it is recommended to assign a on-demand instance for your driver and spot instances as worker nodes.</P><P></P><P>As for a comparison between Spark and Databricks, please visit our comparison page (<A href="https://databricks.com/spark/comparing-databricks-to-apache-spark" alt="https://databricks.com/spark/comparing-databricks-to-apache-spark" target="_blank">https://databricks.com/spark/comparing-databricks-to-apache-spark</A>).</P><P></P> Tue, 28 Jun 2022 14:34:00 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16429#M10615 Cedric 2022-06-28T14:34:00Z Re: What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16430#M10616 <P>Good one @Cedric Law Hing Ping​&nbsp;</P> Tue, 28 Jun 2022 14:43:07 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16430#M10616 Prabakar 2022-06-28T14:43:07Z Re: What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16431#M10617 <P>So the data is copied on other worker nodes?</P><P>Or the data on that worker node is lost?</P> Tue, 28 Jun 2022 15:46:11 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16431#M10617 abd 2022-06-28T15:46:11Z Re: What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16432#M10618 <P>So even if worker node fails between the job. It will resume the job?</P><P>And what about the data on the worker node?</P><P>Is it lost?</P> Tue, 28 Jun 2022 15:53:11 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16432#M10618 abd 2022-06-28T15:53:11Z Re: What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16433#M10619 <P>Yes, the cluster will treat it as a lost worker and schedules the workload to a different worker. Temporary data on the worker will be lost and has to be recomputed by another worker node.</P> Tue, 28 Jun 2022 16:15:16 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16433#M10619 Cedric 2022-06-28T16:15:16Z Re: What will happen if a driver or worker node fails? https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16434#M10620 <P>Alright Thanks </P> Tue, 28 Jun 2022 16:27:51 GMT https://community.databricks.com/t5/data-engineering/what-will-happen-if-a-driver-or-worker-node-fails/m-p/16434#M10620 abd 2022-06-28T16:27:51Z