- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ā05-12-2022 01:24 PM
I am working with Azure Databricks jupyter notebooks and have time-consuming jobs (complex queries, model training, loops over many items, etc.).
Every time I close the browser (or step away for a long time) of some running notebook, even before the cluster time-out time, notebooks and cluster will become idle. When I open the notebook again, it appears as if it the notebook resumes, but it does not continue executing. I'd like to keep the notebook running in the background at night or when I close the browser. Any thoughts ?
- Labels:
-
Azure
-
Azure databricks
-
Notebook
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ā05-25-2022 11:40 PM
I think you should try increasing the inactivity time and if the issue still persists. This should not happen actually @Eric Pā
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ā05-13-2022 11:48 PM
@Eric Pā , To keep the cluster active at all times,
- Disable "Automatic termination"
- create a notebook with simple print
- "%sql select 1" commands and schedule it to run at regular intervals(avoid scheduling forever) to keep the cluster active all the time.
Also, checkout this doc- https://docs.databricks.com/clusters/clusters-manage.html?&_ga=2.26996221.1323833801.1652117370-1078...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ā05-16-2022 01:01 PM
Hi @Kaniz Fatmaā @Aashita Ramtekeā
- There is no "Automatic termination". Are you talking about "Terminate after"
2. I look for a more sustainable solution. Your solution requires running secondary script that continuously pings the server and never stops, which translate to cost. I look for something that does not kill the job half-way and keep it alive until completion. It's a simple capability that every platform support.
Does it mean we can never run a time-consuming job or train a model without sitting there looking at the screen overnight ?
Thank you.
Kenny.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ā05-25-2022 11:40 PM
I think you should try increasing the inactivity time and if the issue still persists. This should not happen actually @Eric Pā
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ā05-26-2022 07:55 AM
@Eric Pā If you want the notebook to be running, why not create and schedule a job for the notebook?
https://docs.microsoft.com/en-us/azure/databricks/data-engineering/jobs/jobs#--create-a-job
![](/skins/images/1C7D039E274DA4E433FB1B1A3EAE173A/responsive_peak/images/icon_anonymous_profile.png)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ā07-07-2022 09:37 AM
Hey @Eric Pā
Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best? If not, please tell us so we can help you.
Thanks!
![](/skins/images/B38AF44D4BD6CE643D2A527BE673CCF6/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/B38AF44D4BD6CE643D2A527BE673CCF6/responsive_peak/images/icon_anonymous_message.png)