Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-24-2025 05:11 AM
Hi @Divya_sreeE
you can pass dynamic variables between tasks using Databricks' job parameters.
1) In your first Python wheel task, generate the dynamic variables and use the Databricks REST API to update the job parameters.
2) In the For Each loop, retrieve the dynamic variables and pass them to the second Python wheel task.
# Retrieve dynamic variables from job parameters
dynamic_variable = os.getenv("DYNAMIC_VARIABLE")