cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

How to get the run_id from a previous task in a Databricks jobs

mmenjivar
New Contributor II

Hi, is there any way to share the run_id from a task_A to a task_B within the same job when task_A is a dbt task?

2 REPLIES 2

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi, You can pass {job_id}} and {{run_id}} in Job arguments and print that information and save into wherever it is needed

please find below the documentation for the same:

https://docs.databricks.com/data-engineering/jobs/jobs.html#task-parameter-variables

{{job_id}}

The unique identifier assigned to a job

1276862

{{run_id}}

The unique identifier assigned to a job run

3447843

{{parent_run_id}}

The unique identifier assigned to the run of a job with multiple tasks.

3447835

{{task_key}}

The unique name assigned to a task that’s part of a job with multiple tasks.

mmenjivar
New Contributor II

I've tried this but it gets the id for the current task

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.