It's good to hear it worked on the new cluster family.

If the quota is already at 83%, the number of nodes your cluster needs is important. If Azure is not able to provision that many resources, it could result in suboptimal performance.

To find out this, please reduce the number of nodes so your cluster can start the job and complete it.