topic Re: Retrieve task name within workflow task (notebook, python)? in Warehousing & Analytics

Retrieve task name within workflow task (notebook, python)?

EWhitley — Wed, 24 Jan 2024 16:35:13 GMT

Using workflows, is there a way to obtain the task name from within a task?

EX: I have a workflow with a notebook task. From within that notebook task I would like to retrieve the task name so I can use it for a variety of purposes.

Currently, we're requiring users to pass the task name into he task using a task parameter. That works, but is another point of configuration and error-prone.

We'd like to obtain the task name from within the task at runtime.

This was asked in a prior conversation (https://community.databricks.com/t5/warehousing-analytics/from-within-a-databricks-notebook-how-do-you-get-the-workflow/td-p/37017), but not answered.

Re: Retrieve task name within workflow task (notebook, python)?

shan_chandra — Thu, 25 Jan 2024 22:00:23 GMT

@EWhitley - could you please try using jobs API - /api/2.1/jobs/get and look for task_key fields to obtain all the task name within a given job.

Reference - https://docs.databricks.com/api/workspace/jobs/get

Re: Retrieve task name within workflow task (notebook, python)?

ttamas — Sat, 22 Jun 2024 03:22:48 GMT

Hi @EWhitley,

Would {{task.name}} help in getting the current task name?

https://docs.databricks.com/en/workflows/jobs/parameter-value-references.htmlPass context about job runs into job t

Re: Retrieve task name within workflow task (notebook, python)?

EWhitley — Tue, 21 Jan 2025 22:51:48 GMT

Apologies for responding so late on this. This is exactly what I needed. 😀