topic How can I pass job parameters to a dbt task? in Data Engineering

How can I pass job parameters to a dbt task?

jabori — Thu, 29 Feb 2024 16:43:25 GMT

I have a dbt task that will use dynamic parameters from the job: {"start_time": "{{job.start_time.[timestamp_ms]}}"}

My SQL is edited like this:
select 1 as id
union all
select null as id
union all
select {start_time} as id

This causes the task to fail. How can I pass the start_time parameter correctly?

MathieuDB — Mon, 13 Jan 2025 20:39:03 GMT

Can you try using the var() function to see if it fix the issue?

select 1 as id union all select null as id union all select {{ var('start_time') }} as id

MathieuDB — Mon, 13 Jan 2025 20:41:08 GMT

Also, you need to pass the parameters using the --vars flag like that:

dbt run --vars '{"start_time": "{{job.start_time.[timestamp_ms]}}"}'

You will need to modify the 3rd dbt command in your job.