Hubert-Dudek
Databricks MVP

‎06-28-2022 06:46 AM

  • a worker is not a problem as it is RDD, so the dataset will survive on other workers, and new workers will be automatically deployed in databricks,
  • a driver is critical as without a driver whole cluster will fail (that's why you shouldn't use spot instances for the driver, but for workers is not a problem)

My blog: https://databrickster.medium.com/