Job scheduled run fail alert
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ08-30-2024 02:04 AM
Hello,
I have a job that should run every six hours. I need to set up an alert for the case if this doesn't start (for example, someone paused it). How do I configure such an alert using Databricks native alerts?
Theoretically, this may be done using system tables and SQL Alerts. But the problem is that:
Currently no support for real-time monitoring. Data is updated throughout the day. If you donโt see a log for a recent event, check back later. link
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ12-27-2024 10:00 AM - edited โ12-27-2024 10:01 AM
Thank you for your question! Hereโs a concise workflow to set up an alert for missed job runs in Databricks:
- Write a Query: Use system tables to identify jobs that havenโt started on time.
- Save the Query: Save this query in Databricks SQL as a named query.
- Create an Alert:
- Go to Alerts in Databricks SQL.
- Create a new alert based on the saved query.
- Set the condition to trigger when the query returns rows.
- Set Notifications: Add email, Slack, or PagerDuty notifications for the alert.
- Schedule the Query: Set the query to run every 5-10 minutes to check for missed runs.
This will alert you when the job hasnโt run as expected. Let me know if you need clarification!
![](/skins/images/B38AF44D4BD6CE643D2A527BE673CCF6/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/B38AF44D4BD6CE643D2A527BE673CCF6/responsive_peak/images/icon_anonymous_message.png)