Greetings, I have similar problem.

Did you try to use Databricks workflows instead and schedule them instead on Data Factory?

Because inside workflows it is possible to select a specific branch, so it may actually work.

What do you think?