saurabh18cs
Honored Contributor III

Hi @Divya_sreeE 

you can pass dynamic variables between tasks using Databricks' job parameters.

1) In your first Python wheel task, generate the dynamic variables and use the Databricks REST API to update the job parameters.

2) In the For Each loop, retrieve the dynamic variables and pass them to the second Python wheel task.

   # Retrieve dynamic variables from job parameters
    dynamic_variable = os.getenv("DYNAMIC_VARIABLE")