How to restart Databricks Cluster at specific time?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ09-22-2022 09:43 AM
Command available for restart but not at specific time.
databricks clusters restart --cluster-id <>
- Labels:
-
Databricks Cluster
-
Specific Time
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ09-22-2022 04:09 PM
Hi @Trushna Khatriโ , I dont see an option to restart the cluster at a specific time. However, you can achieve this by scheduling a cron job in your terminal. By this, you can set the time to restart your cluster from cli.
The below cron job will restart the cluster daily at 00:00 hrs (mid-night)
0 0 * * * databricks clusters restart --cluster-id 1234-567890-batch123
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ09-26-2022 01:07 PM
@Trushna Khatriโ adding some more information to prabakar. can you please let me know what is actual need of starting cluster during specific time. usually if you criteria is to use for jobs go with job cluster. here cluster start when ever your job start and stops when ever you job gets completed
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ09-26-2022 02:25 PM
Actually few pipelines are failed and there is some GC issue. right now manually restart the cluster so need to automate the restart cluster at 8 PM daily. Main thing is as per data coming continuously we cant stop and then start the cluster as we have 30 mins window time

