Cluster terminated. Reason: Spark Startup Failure: Spark was not able to start in time

User16826994223
Databricks Employee
Databricks Employee

‎06-22-2021 03:48 AM

Cluster terminated. Reason: Spark Startup Failure: Spark was not able to start in time. This issue can be caused by a malfunctioning Hive metastore, invalid Spark configurations, or malfunctioning init scripts. Please refer to the Spark driver logs to troubleshoot this issue, and contact Databricks if the problem persists. Internal error message: 

Spark failed to start: Driver failed to start in time

.

0 Kudos

User16826994223
Databricks Employee
Databricks Employee

‎06-22-2021 03:49 AM

I Think Container is unable to talk to hosting instance or DBFS account. It Can be solved by adding a custom route to the subnets for the DBFS account with the next hop being public route.

View solution in original post

0 Kudos