โ01-09-2023 03:04 AM
I am using the edit notification in databricks to send email notification in case of workflow failure or success. How can I add additional information to this report for example if I want to notify about number of rows got processed or added how can I do this
โ01-09-2023 07:05 AM
@Rohit Kapoorโ If you want more control over notifications I'd check out Alerts in DB SQL. You can set custom Alert Destinations and create SQL queries for fine-grained control. For example, you can jobs to schedule a DLT pipeline to run and then trigger an alert right after to send an email with how many rows were processed or how many rows failed.
โ01-09-2023 07:02 AM
Hi @Rohit Kapoorโ :
There is a new format for job emails, this can be enabled from Admin console -> Workspace settings
I think any additional information apart from above image can be appended to the error message in catch block of your program.
Another option is to implement a function to send mails, so you can customize your message and send it on success/ failure.
Hope this helps
Thanks,
RKNutalapati
โ01-09-2023 07:05 AM
@Rohit Kapoorโ If you want more control over notifications I'd check out Alerts in DB SQL. You can set custom Alert Destinations and create SQL queries for fine-grained control. For example, you can jobs to schedule a DLT pipeline to run and then trigger an alert right after to send an email with how many rows were processed or how many rows failed.
2 weeks ago
I am trying alerts option to send an email but when I am trying to add email address in destination it is not allowing me to add. Only user id it is allowing. Please help. Also, I am trying to send emails directly from notebooks using SMTP server provided by my company but again timeout error is coming
2 weeks ago
There are three approaches I can think of for this:
Approach 1: Creating an email template and sending emails programmatically from DBX Notebook.
Approach 2: Invoke a Logic App via an Azure REST API from Databricks after the code executes successfully or in the failure (catch) block.
Approach 3: Invoke a Webhook that internally triggers a Logic App to send an email using a predefined template.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group