cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Email destination not appearing in Job's System Notification list.

TheRealJimShady
New Contributor

On job failure I need to send an email with a custom subject line. I have configured the email address as a destination with the subject that I need, but I don't see it as an option that I can choose in the 'System Notification' dialog in the job settings. Why is that?

Screenshot 2023-03-30 161113Screenshot 2023-03-30 161231

1 ACCEPTED SOLUTION

Accepted Solutions

ChrisThompson
Databricks Employee
Databricks Employee

Hi,

I got a response back from the team and right now there are both technical limitations, and also no firm plans to support centrally configured emails with jobs.

You might wonder why the UI allows you to add these other ones (Email, Teams, Etc.). It is because that part of the platform is also shared with redash, where they can all be used.

As a workaround, we recommend using the webhook option to call an external service that can then do an email notificationโ€ฆ

cc: @Ajay Pandeyโ€‹ , @James Smithโ€‹ 

View solution in original post

7 REPLIES 7

Ajay-Pandey
Esteemed Contributor III

Hi @James Smithโ€‹ ,

I am also facing the same issue @Chris Thompsonโ€‹ can you please help in this.

Ajay Kumar Pandey

Hi Ajay, did you mean to tag Chris Williams?

ChrisThompson
Databricks Employee
Databricks Employee

In answer to the question, I've asked the product team as that does seem a bit odd.

I have not tried this, but you could try to use the Jobs API https://docs.databricks.com/dev-tools/api/latest/jobs.html#operation/JobsCreate and give it the Id of the Email destination under the failure condition.

I would need to test that though..

Ajay-Pandey
Esteemed Contributor III

Thanks

Sure, will try this.

Ajay Kumar Pandey

ChrisThompson
Databricks Employee
Databricks Employee

Hi,

I got a response back from the team and right now there are both technical limitations, and also no firm plans to support centrally configured emails with jobs.

You might wonder why the UI allows you to add these other ones (Email, Teams, Etc.). It is because that part of the platform is also shared with redash, where they can all be used.

As a workaround, we recommend using the webhook option to call an external service that can then do an email notificationโ€ฆ

cc: @Ajay Pandeyโ€‹ , @James Smithโ€‹ 

Ajay-Pandey
Esteemed Contributor III

Hi @Chris Thompsonโ€‹ ,

โ€‹

Thanks for quick reply.

Ajay Kumar Pandey

Anonymous
Not applicable

Hi @James Smithโ€‹ 

Hope everything is going great.

Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you. 

Cheers!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group