Quota Limit Exhausted Error when Creating declarat...

crami · ‎10-31-2025

I am trying to develop a declarative pipeline. As per platform policy, I cannot use serverless, reason, I am using asset bundle to create declarative pipeline. In the bundle, I am trying to specify compute for the pipeline. However, I am constantly facing quota exhausted exception.
Example: Below is compute config I am specifying..

Below is quota availability..

I have tried specifying DSv2 and DSv3 family cluster, all hit the same issue...
Is there any specific configuration I may need to specify for cluster to instantiate ?
Exception:

Khaja_Zaffer · ‎10-31-2025

Hello @crami

Good day!!

As the error tells. you need to increase the VM size, i know you have enough things in your place but

spot fallback + Photon + autoscale triggers the failure.

Go to

Azure Portal → Subscriptions →

Usage + quotas

Filter: Provider=Microsoft.Compute, Location=

Also, did you try with availability as "ON_DEMAND"?

Redeploy bundle: databricks bundle deploy Start pipeline. This might bypasses spot quota/capacity checks.

i am also looking for resolutions from other contributors.

Thank you.

crami · ‎11-01-2025

Thanks for pointer.

Quota Limit Exhausted Error when Creating declarative pipeline