topic how to manage the databricks failure notifications to slack webhook? in Data Engineering

how to manage the databricks failure notifications to slack webhook?

jeremy98 — Fri, 22 Aug 2025 09:11:01 GMT

Hi community,
I’d like to handle the case when one of our Databricks jobs fails. From the documentation, I understand that the HTTP response from Databricks will look like this:

{ "event_type": "jobs.on_failure", "workspace_id": "your_workspace_id", "run": { "run_id": "run_id" }, "job": { "job_id": "job_id", "name": "job_name" } }

How to set the webhook slack channel to retrieve the job name under :

"job": {
"job_id": "job_id",
"name": "job_name"
}

Re: how to manage the databricks failure notifications to slack webhook?

jeremy98 — Fri, 22 Aug 2025 09:11:55 GMT

bc this:

is not correct I suppose, right?

Re: how to manage the databricks failure notifications to slack webhook?

szymon_dybczak — Fri, 22 Aug 2025 10:59:43 GMT

Hi @jeremy98 ,

I don't have a slack to test it myself, but according to their docs it's not currently possible to use nested JSON structures in workflow variables.
Anyway, it might be worth trying to use dot notation to access nested fields. So try to define job_name variable as job.name. Maybe it will work (it's small chance though, since they mentioned in docs that nested stuctures won't work, but it doesn' hurt to try )