topic Re: Cluster in Pending State for long time in Data Engineering

Cluster in Pending State for long time

Anonymous — Wed, 16 Jun 2021 21:03:00 GMT

Pending for a long time at this stage “Finding instances for new nodes, acquiring more instances if necessary”. How can this be fixed?

Re: Cluster in Pending State for long time

User16826994223 — Wed, 23 Jun 2021 07:51:42 GMT

A couple of quick notes:

* Finding instances for new nodes means that Databricks is attempting to provision the AWS instances necessary. This will often take longer if A) the cluster is larger, or B) the cluster is a spot cluster.

* They should not stay in this state for longer than ~30 minutes however (because of a timeout); if it does please let us know.

* It is on the roadmap to A) allow users to terminate pending clusters, or B) have Databricks return a smaller cluster if it wasn't able to provision all the instances, but that's not there yet.

Re: Cluster in Pending State for long time

bhawana-pandey — Thu, 19 Jan 2023 07:44:54 GMT

I am using AWS Databricks account and facing the same issue. Not sure, how to mitigate the same and work on compute.

Re: Cluster in Pending State for long time

bhawana-pandey — Thu, 19 Jan 2023 07:50:11 GMT

Figured out after multiple connects that This is typically a cloud provider issue. You can file a support ticket if the issue persists.

Re: Cluster in Pending State for long time

rswarnkar5 — Wed, 20 Aug 2025 04:02:00 GMT

I faced similar situation yesterday. So I kept waiting instead of locking my system or closing the tabs. After sometime it went all fine.