topic Override DLT Fille Refresh using a Job parameter in Data Engineering

Override DLT Fille Refresh using a Job parameter

Trifa — Tue, 28 Nov 2023 11:23:16 GMT

Hello

I have a Job with a DLT pipeline as a first task. From time to time, I want to execute this Job with a Full Refresh of the DLT pipeline. How could I override my default "full_refresh = false" ?

This was possible before using the Legacy parameters layout

Thanks

Re: Override DLT Fille Refresh using a Job parameter

adriennn — Tue, 11 Mar 2025 07:29:42 GMT

Use a conditional task to trigger two different tasks depending ou your parameters (I know 😕 )

Re: Override DLT Fille Refresh using a Job parameter

Trifa — Mon, 17 Mar 2025 13:44:22 GMT

Thanks @adriennn

That's actually a decent fix for my problem

Re: Override DLT Fille Refresh using a Job parameter

adriennn — Mon, 17 Mar 2025 14:00:16 GMT

@Trifa luckily, it's simple to implement. You can be the guys are going to release Pipeline Parameters® a week after you have deployed your solution though 😉