topic Re: Dynamic inference tasks in workflows using dabs in Data Engineering

Dynamic inference tasks in workflows using dabs

21f3001806 — Tue, 08 Apr 2025 05:56:04 GMT

I have some workflows where we use dynamic inference to set task values or capture job executions counts or output rows. Is there any way I can set these dynamic values using the ui but can i do the same at the time of dabs workflow creation. Can you refer me the doc for it , i cannot find

Re: Dynamic inference tasks in workflows using dabs

21f3001806 — Tue, 08 Apr 2025 07:13:27 GMT

Re: Dynamic inference tasks in workflows using dabs

ashraf1395 — Tue, 08 Apr 2025 07:58:25 GMT

Hi there @21f3001806 ,
You can use dynamic inference values the same way in dabs ass in ui
You can call them similarly like {{job.id}} in base_parameters or job_tasks.

Here are some docs which can help :
- https://docs.databricks.com/aws/en/jobs/dynamic-value-references
- https://docs.databricks.com/aws/en/dev-tools/bundles/job-task-types
These have examples on what type of dynamic_inference you can use and how to use them in dabs

Re: Dynamic inference tasks in workflows using dabs

21f3001806 — Tue, 08 Apr 2025 11:20:31 GMT

Thanks @ashraf1395 , I got the idea of what I was looking for.