I'm sorry, but there's a couple of things I need to call out in your response @anuj_lathi .

  1. The response was marked as "Accepted Solution", but I did not personally review and accept this as a solution. So I have marked as "Not the Solution".
  2. The response "seems" to be AI generated, which nowadays is not inherently a bad thing so long as it is verified before posting.
  3. The "recommended" approach suggested simply does not work. This functionality does not exist in Databricks as described (which is my original suspicion)
    • I *cannot* reference the child1 task run_id outside of parent1 by parent2
      • {{tasks.parent1.values.child1_run_id}}
    • I *can* reference the parent1 task run_id outside of parent1 by parent2
      • {{tasks.parent1.run_id}}
      • This is not what I'm looking for necessarily, but it seems like the only thing that is exposed via existing Job Workflow functionality

Attached images for reference.