Cluster terminated. Reason: Spark Startup Failure: Spark was not able to start in time

[User16826994223]

Cluster terminated. Reason: Spark Startup Failure: Spark was not able to start in time. This issue can be caused by a malfunctioning Hive metastore, invalid Spark configurations, or malfunctioning init scripts. Please refer to the Spark driver logs to troubleshoot this issue, and contact Databricks if the problem persists. Internal error message: 

Spark failed to start: Driver failed to start in time

.

[User16826994223 · Accepted solution]

I Think Container is unable to talk to hosting instance or DBFS account. It Can be solved by adding a custom route to the subnets for the DBFS account with the next hop being public route.