Pass parameters between jobs

dpc
Contributor III

Hello

 

I have job

In that job, it runs a task (GetGid) that executes a notebook and obtains some value using dbutils.jobs.taskValuesSet

e.g. dbutils.jobs.taskValuesSet(key = "gid", value = gid)

As a result, I can use this and pass it to another task for use by setting the parameter

e.g. Key - gid; Value - {{tasks.GetGid.values.gid}}

This works find and it see gid and uses it (the task runs a sql notebook with a widget

 

How do I pass and use this to a job task?

gid should be passed such that it can be used in tasks there

e.g. a futher notebook task or maybe an if/then task

All within the downstream job

 

I can do this easily in Azure Data Factory but cannot find a solution in databricks

 

Any ideas?

Is this even possible? It feels fairly basic

 

Thanks