cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Cluster in Pending State for long time

Anonymous
Not applicable

Pending for a long time at this stage โ€œFinding instances for new nodes, acquiring more instances if necessaryโ€. How can this be fixed?

3 REPLIES 3

User16826994223
Honored Contributor III

A couple of quick notes:

* Finding instances for new nodes means that Databricks is attempting to provision the AWS instances necessary. This will often take longer if A) the cluster is larger, or B) the cluster is a spot cluster.

* They should not stay in this state for longer than ~30 minutes however (because of a timeout); if it does please let us know.

* It is on the roadmap to A) allow users to terminate pending clusters, or B) have Databricks return a smaller cluster if it wasn't able to provision all the instances, but that's not there yet.

Databricks_Buil
New Contributor III

I am using AWS Databricks account and facing the same issue. Not sure, how to mitigate the same and work on compute.

Databricks_Buil
New Contributor III

Figured out after multiple connects that This is typically a cloud provider issue. You can file a support ticket if the issue persists.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group