cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

User Initiated Cluster Termination, after 1-2 hours cluster goes offline even while working!

gazzyjuruj
Contributor II

Hi,

Wanted to ask, I have been experiencing

databricks_error = user initiated cluster termination

databricks_error_message: timeout while placing nodes

and soetimes it stays stuck on "finding new nodes, instances if neccessary" for hours..

and it goes offline usually after 1-2 hours while working, what is causing this? How do we fix it?

Thank you, have a great day ahead.

2 REPLIES 2

Hi yes, it does go offline "connection closed" in case im using terminal even faster maybe only in 30 minutes.

and in 2 hours it goes off, i know the idle timeout limits, but my processes are running while it goes down.

and on the Client.UserInitiatedShutdown error im again running my applications and i will update you in the next 1-2 hours. Thanks @Kaniz Fatma​ 

Atanu
Databricks Employee
Databricks Employee

We have identified that the recent deployment done on the backend service on which Azure Data factory relies upon had prevented the data flow activity from running and this had caused the issue

But can you confirm @Ghazanfar Uruj​ if the issue persists . also the timeline would help.

Thanks

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group