Databricks Community

udrao56al · yesterday

I am using azure free subscription and enable databricks 14 days free trial and when starting compute its showing this, even though setting min and max workers to 1,it also shows quota exceeded , i haven't used any since three days.

This account may not have enough CPU cores to start a cluster. Contact your administrator to increase the limits.

Learn more about CPU quota.

how to resolve please suggest ,tried all the ways possible
Message Failed to add 2 workers to the compute. Will attempt retry: true. Reason:Azure Quota Exceeded Exception Help The VM size you are specifying is not available. [details] QuotaExceeded: Operation could not be completed as it results in exceeding approved Total Regional Cores quota. Additional details - Deployment Model: Resource Manager, Location: eastus, Current Limit: 4, Current Usage: 4, Additional Required: 4, (Minimum) New Limit Required: 8. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%... by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/regional-quota-requests(OnDemand)

Louis_Frolio · yesterday

Greetings @udrao56al

Based on the error message in the screenshot, the issue is that the Azure free trial subscription has reached its CPU core quota limit. Here's a response to help resolve this problem:

Understanding the Problem

The Azure free trial subscription has a hard limit of 4 CPU cores, and the account is currently using all 4 cores. Databricks clusters require additional cores beyond this limit - even a minimal single-node cluster configuration typically needs at least 4 cores, and multi-node clusters require 8 or more cores.

Why Free Trial Subscriptions Are Limited

Free trial and student subscriptions cannot run Azure Databricks clusters effectively because the 4-core quota is insufficient for Databricks compute requirements. Additionally, free trial subscriptions are not eligible for quota increases, which means requesting additional cores through Azure support won't work with this subscription type.

Solutions

Immediate Options

Check for active resources: Navigate to the Azure portal and verify if there are any other VMs or compute resources consuming cores in the subscription. If found, stop or delete them to free up the quota.

Long-term Solution

Upgrade to Pay-As-You-Go: The most reliable solution is to upgrade from the free trial to a Pay-As-You-Go subscription. This allows you to request quota increases through Azure support and run Databricks clusters properly. With a paid subscription, you can submit quota increase requests through the Azure portal's "Help + support" section .

Key Takeaway

The error message is accurate - the free trial subscription fundamentally cannot support Databricks clusters due to the 4-core limitation. Even though the Databricks workspace itself is available for free trial, the underlying compute infrastructure requires more resources than the free tier provides.

Hope this helps, Louis.