Hi @bergmaal , I am experiencing the same issue.
My Databricks consultant suggested opening a support ticket as this should not be normal behavior.

Did you solve this issue yet?

We observed these delays do not seem to occur in workflows that use notebooks in the "Workspace".

We observed the delays mainly if the tasks reference notebooks in GIT repositories by "branch" or "commit" (example in attached image).