Databricks Community

hgintexas

The system.lakeflow.job_task_run_timeline does not include the task level parameters on the input of the for each loop if dynamically setting the parameter in another notebook using dbutils.jobs.taskValues.set. This information is not included in the...

hgintexas

We use for-each loops with dynamic variables across many of our jobs, so addressing this would be a significant effort. Since a new task_id is assigned for each for-each iteration, if one of the iterations fails it’s difficult to determine which iter...

Databricks Community

User Stats

User Activity

system.lakeflow.job_task_run_timeline table missing task parameters on for each loop input

Re: system.lakeflow.job_task_run_timeline table missing task parameters on for each loop input