The only thing that's coming to me right now is that maybe this can be done by making each task it's own job (which it is in my example but isn't normally) and putting the conditional into each job. But I don't think this is super feasible because it would mean turning any singular task into its own job.

The team I'm working with previously did this by setting the control in the notebook itself, but the problem with this is that it would have to wait to spin up the cluster to do this and some of their jobs have a couple of different clusters that shouldn't all need to spin up just to check if that a notebook should run.