โ07-05-2023 05:47 AM
I have a notebook where i want to use the workflow name and task name that it will be running under. How do i access these information?
โ07-05-2023 08:10 AM
Please take a look at these docs, I think they are what you need: https://docs.databricks.com/workflows/jobs/task-parameter-variables.html
โ07-05-2023 08:10 AM
Please take a look at these docs, I think they are what you need: https://docs.databricks.com/workflows/jobs/task-parameter-variables.html
โ07-05-2023 09:17 AM
Thanks. That looks like a promising option to access task level information. Is there a way to access workflow name?
โ07-05-2023 11:40 AM
No, we don't include that as it is not a unique or stable identifier. You can query the Jobs API to retrieve it.
โ07-06-2023 10:48 AM
Okay. Thanks.
Instead i am now going to use base_parameters on deployment.conf and catch those parameters with dbutils.widget.get()
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group