Retrieve task name within workflow task (notebook, python)?

EWhitley
Databricks Partner

Using workflows, is there a way to obtain the task name from within a task?

EX: I have a workflow with a notebook task. From within that notebook task I would like to retrieve the task name so I can use it for a variety of purposes.

Currently, we're requiring users to pass the task name into he task using a task parameter. That works, but is another point of configuration and error-prone.

We'd like to obtain the task name from within the task at runtime.

This was asked in a prior conversation (https://community.databricks.com/t5/warehousing-analytics/from-within-a-databricks-notebook-how-do-y...), but not answered.

shan_chandra
Databricks Employee
Databricks Employee

@EWhitley - could you please try using jobs API - /api/2.1/jobs/get and look for task_key fields to obtain all the task name within a given job. 

Reference - https://docs.databricks.com/api/workspace/jobs/get

EWhitley
Databricks Partner

Apologies for responding so late on this. This is exactly what I needed. 😀