topic Cannot spin up a cluster in Data Engineering

Cannot spin up a cluster

BWong — Wed, 04 Jan 2023 14:23:33 GMT

When I try to spin up a cluster, it gives me a bootstrap timeout error

{

"reason": {

"code": "BOOTSTRAP_TIMEOUT",

"parameters": {

"databricks_error_message": "[id: InstanceId(i-00b2b7acdd82e5fde), status: INSTANCE_INITIALIZING, workerEnvId:WorkerEnvId(workerenv-696756232821330-464716cc-9cde-40c3-801b-2fd22c730b92), lastStatusChangeTime: 1672839978982, groupIdOpt None,requestIdOpt Some(1027-150240-fzpsvxhz-4f60193c-2bf8-47ae-a),version 1] with threshold 700 seconds timed out after 701403 milliseconds. Please check network connectivity from the data plane to the control plane.",

"instance_id": "i-00b2b7acdd82e5fde"

}

The weird thing is if I start a new cluster in the same workspace, I have exactly the same problem. But if I create a new workspace with the same Credential configuration and same Storage configuration, then I can create a new cluster and start it with no problem.

The system log from EC2 instance i-00b2b7acdd82e5fde is attached

Any help would be much appreciated!

Billy

Re: Cannot spin up a cluster

Hubert-Dudek — Thu, 05 Jan 2023 10:08:39 GMT

It seems like a network (routing, subnets) configuration issue.

Re: Cannot spin up a cluster

BWong — Fri, 06 Jan 2023 09:06:48 GMT

Thanks guys. It's indeed a network issue on the AWS side. It's resolved now

Re: Cannot spin up a cluster

Cano — Wed, 11 Jan 2023 21:16:54 GMT

Can you please provide details on how you were able to resolve this problem? I am currently experiencing the same thing and I am confused on how to tackle it.

Re: Cannot spin up a cluster

BWong — Thu, 12 Jan 2023 10:26:23 GMT

Hi @Cano, I looked for the instances on AWS console created by Databricks, then checked its VPC. My problem was a inbound rules in the ACL was restricted to SSH. Once I changed it to allow all inbound traffic it works correctly

Re: Cannot spin up a cluster

Cano — Thu, 12 Jan 2023 16:43:36 GMT

Thanks for the response @Billy Wong , it unfortunately didn't work even after all the network requirements were met. I am going to try to create a new workspace 😔 and see if that helps.

Re: Cannot spin up a cluster

Cano — Fri, 13 Jan 2023 16:22:39 GMT

@Billy Wong

Can you please confirm if you use a NAT gateway or internet gateway?

Re: Cannot spin up a cluster

Debayan — Thu, 05 Jan 2023 18:48:04 GMT

Hi, As per the error says, "Please check network connectivity from the data plane to the control plane." Could you please cross verify the network configurations in your data plane and let us know if that helps.

Re: Cannot spin up a cluster

Kaviana — Thu, 23 Nov 2023 15:07:50 GMT

@BWong @Cano

Good morning, I want to ask you if you may share knowledge of how it was adjusted from AWS?

Thank you