cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to restart Databricks Cluster at specific time?

Trushna
New Contributor II

Command available for restart but not at specific time.

databricks clusters restart --cluster-id <>

3 REPLIES 3

Prabakar
Databricks Employee
Databricks Employee

Hi @Trushna Khatriโ€‹ , I dont see an option to restart the cluster at a specific time. However, you can achieve this by scheduling a cron job in your terminal. By this, you can set the time to restart your cluster from cli.

The below cron job will restart the cluster daily at 00:00 hrs (mid-night)

0 0 * * * databricks clusters restart --cluster-id 1234-567890-batch123

karthik_p
Esteemed Contributor

@Trushna Khatriโ€‹ adding some more information to prabakar. can you please let me know what is actual need of starting cluster during specific time. usually if you criteria is to use for jobs go with job cluster. here cluster start when ever your job start and stops when ever you job gets completed

Trushna
New Contributor II

Actually few pipelines are failed and there is some GC issue. right now manually restart the cluster so need to automate the restart cluster at 8 PM daily. Main thing is as per data coming continuously we cant stop and then start the cluster as we have 30 mins window time

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group