topic Re: Bootstrap Timeout during cluster start in Data Engineering

Bootstrap Timeout during cluster start

LearningDatabri — Thu, 02 Jun 2022 10:00:48 GMT

sometimes while starting a cluster I am facing bootstrap timeout error, what is the reason? when I try the next time it starts the cluster.

Re: Bootstrap Timeout during cluster start

Prabakar — Thu, 02 Jun 2022 10:02:54 GMT

In which region your workspace is deployed? Also which is the cloud provider? We recently applied a fix to resolve this bootstrap error.

Re: Bootstrap Timeout during cluster start

LearningDatabri — Thu, 02 Jun 2022 10:25:16 GMT

AWS useast1

Re: Bootstrap Timeout during cluster start

Prabakar — Thu, 02 Jun 2022 15:25:40 GMT

We are aware of this issue and our engineering team made a fix for this issue. The fix will be deployed this week.

Re: Bootstrap Timeout during cluster start

Bert613 — Wed, 23 Aug 2023 13:40:36 GMT

Hello, we have started to see this issue in Canada Central, on Azure, mostly around 6:15am.

Re: Bootstrap Timeout during cluster start

MaheshMandlik — Mon, 29 Jul 2024 04:53:29 GMT

Hi - We have seen this issue on old workspace ( AWS Oregon us-west-2) , couple of times - 1. 26th July and 2. Today 29th July

Cluster '0729-040008-6c2diu36' was terminated. Reason: BOOTSTRAP_TIMEOUT (SERVICE_FAULT). Parameters: databricks_error_message:[id: InstanceId(i-0f5f6b6bd5d37a52a), status: INSTANCE_INITIALIZING, workerEnvId:WorkerEnvId(workerenv-3325107197771046-7201c2b6-6e0c-4e92-9792-2eaf55bc5ffd), lastStatusChangeTime: 1722225709727, groupIdOpt Some(-7472147180756461083),requestIdOpt Some(0729-040008-6c2diu36-b8587b40-d987-4795-a),version 3] with threshold 700 seconds timed out after 700133 milliseconds. Please check network connectivity from the data plane to the control plane., instance_id:i-0f5f6b6bd5d37a52a.

Re: Bootstrap Timeout during cluster start

Manish_Pundir — Mon, 02 Dec 2024 12:42:17 GMT

By adding this property on cluster level, it started working.

spark.sql.legacy.timeParserPolicy to LEGACY

Re: Bootstrap Timeout during cluster start

M_waleed — Mon, 02 Dec 2024 12:50:11 GMT

The bootstrap timeout error happens when the cluster setup process takes too long, usually due to network delays, resource allocation issues, or communication problems with the cloud provider. It’s likely a temporary glitch, which is why retrying works the next time. If it keeps happening, check your cluster configurations or contact support for troubleshooting.

Re: Bootstrap Timeout during cluster start

PabloCSD — Thu, 12 Dec 2024 15:13:29 GMT

I'm having this issue too (and also a colleague) in the eastus region:

run failed with error message Cluster '1212-135649-a2x5p6jg' was terminated. Reason: BOOTSTRAP_TIMEOUT (SERVICE_FAULT). Parameters: databricks_error_message:Bootstrap Timeout. Please try again later. Instance bootstrap inferred timeout reason: UnknownReason Failure message: Bootstrap script took too long and timeout. VM extension code: ProvisioningState/succeeded instanceId: InstanceId(022733c3085c4460ade4fa8042d12c85) workerEnv: workerenv-6505902102920425 Additional details (may be truncated):

Re: Bootstrap Timeout during cluster start

drag7ter — Tue, 21 Jan 2025 09:25:24 GMT

I'm having this issue in

eu-west

It really impacts our PROD runs regularly

Re: Bootstrap Timeout during cluster start

Amine8089 — Thu, 13 Feb 2025 09:27:58 GMT

i have this issue, can someone help on that ?
Instance bootstrap failed command: Bootstrap_e2e Instance bootstrap inferred timeout reason: Command_UpdateWorker_Slow Failure message (may be truncated): Bootstrap is terminated spontaneously by VM because self timeout was reached. Slowest command Command_UpdateWorker took 512.6377 seconds

Re: Bootstrap Timeout during cluster start

Amine8089 — Thu, 20 Feb 2025 10:34:25 GMT

My issue is resolved now.
It was due to network configuration changes on the backend. Routing tables have been updated.