-werners-
Esteemed Contributor III

I moved away from pools since cluster reuse is possible in databricks jobs.
Why? More control over your workers, no need to find a good waiting time and you can even run multiple tasks on a single cluster.
Why your jobs fail is not clear to me.
When no more workers can be assigned, the running jobs do not fail afaik.  What will fail however is new jobs, as they cannot spin up a cluster (needs at least a driver).