topic Re: Is there a way to have multiple triggers for a single workflow? in Data Engineering

Is there a way to have multiple triggers for a single workflow?

Peter-M — Tue, 11 Jun 2024 22:59:38 GMT

Re: Is there a way to have multiple triggers for a single workflow?

Felipe — Tue, 11 Jun 2024 23:18:28 GMT

You could maybe have different workflows with different triggers that call your target/main workflow

Re: Is there a way to have multiple triggers for a single workflow?

jacolei — Wed, 12 Jun 2024 00:19:45 GMT

Absolutely, you would design a trigger for one task (eg new file) and another one (eg schedule), then have a third task that runs when both of those tasks complete

Re: Is there a way to have multiple triggers for a single workflow?

mhiltner — Wed, 12 Jun 2024 00:34:12 GMT

You could have a workflow with two tasks, one being a "trigger checker" that could be a super light task scheduled to run every X hours/minutes. This first task would check for your different triggers and define a success criteria for your next task. Then you condition the actual task that you need to execute only if one of these conditions are satisfied.