cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Set a theshold Notification on Job run time.

rwalrondNHS
New Contributor

Hello all, I am brand new to Databricks, so forgive me if this question has been answered before,  but what i want to do is set a run time threshold to my Databricks Jobs such that if the job which say normally runs for 30 minutes, runs for over an hour,  then i get an email notification.

I have found the Job-Notifications section within the Databricks Job, and I can set it there in the UI. But according to CoPilot, I cannot programmatically set this and as soon as i do a code deploy/rebuild,  the values will get removed.

Is it true that I can't set these through code and that any manual set is wiped out?

It seems a bit weird to me as it kind of makes the Ui ability worthless? I have weekly deploys by the way which would mean a manual set every week if the above is true.  Cheers all.

 

 

 

1 REPLY 1

-werners-
Esteemed Contributor III

The notification settings are determined either by the UI or by DAB (formerly known as databricks asset bundles).
In either case they represent a fixed value and not a relative one (like 2 times the time of the previous run).
DAB is not code but yml config. But as said: a fixed value, not a formula.
Basically you either use the UI or DAB, because if you use both, the one will overwrite the other.

That being said: I would use dab. it is not real code but with yml quite a lot is possible.  But only fixed values though for this case.