Hello,

For one of my clients, we are using an all-purpose cluster to run some Databricks notebooks. We noticed in the logs of the cluster some Azure Quota Exceptions, from which we would like to know more.

As you can see attached, the cluster always succeeds to reach its maximum nodes capacity (8 in this case), but increasing slowly from a number of nodes to another (which is understandable due to autoscaling). What we would like to explain is the "error" message almost every time it tries to upsize the number of nodes: "Compute upsize complete, but below the target size. Operation could not be completed as it results in exceeding approved LowPriorityCores quota". 

Note that this does not cause the job to fail, but I would still like to investigate and understand why these "failures" when upsizing. 

Also, we are using the Azure cloud for Databricks, and we do not have quota issues as you can also see on the second image attached.

Thanks a lot for the help,

Sacha