cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Cluster in Pending State for long time

Anonymous
Not applicable

Pending for a long time at this stage โ€œFinding instances for new nodes, acquiring more instances if necessaryโ€. How can this be fixed?

3 REPLIES 3

User16826994223
Honored Contributor III

A couple of quick notes:

* Finding instances for new nodes means that Databricks is attempting to provision the AWS instances necessary. This will often take longer if A) the cluster is larger, or B) the cluster is a spot cluster.

* They should not stay in this state for longer than ~30 minutes however (because of a timeout); if it does please let us know.

* It is on the roadmap to A) allow users to terminate pending clusters, or B) have Databricks return a smaller cluster if it wasn't able to provision all the instances, but that's not there yet.

Databricks_Buil
New Contributor III

I am using AWS Databricks account and facing the same issue. Not sure, how to mitigate the same and work on compute.

Databricks_Buil
New Contributor III

Figured out after multiple connects that This is typically a cloud provider issue. You can file a support ticket if the issue persists.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.