https://community.databricks.com/t5/data-engineering/quota-exhaustion-issues-in-your-student-account/m-p/117722#M45553 <P>Hello&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/163358">@Dinesh6351</a>!</P> <P>This error occurs when your Azure account exceeds the available regional core quota, preventing the pipeline cluster from launching. Here, Databricks pipeline cluster attempted to use more resources than allowed. <BR />To resolve this, review the pipeline's cluster configuration and consider reducing resource usage, by selecting smaller instance types, limiting the number of worker nodes, or optimizing data processing.</P> Mon, 05 May 2025 14:28:14 GMT Advika 2025-05-05T14:28:14Z https://community.databricks.com/t5/data-engineering/quota-exhaustion-issues-in-your-student-account/m-p/117700#M45550 <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Dinesh6351_0-1746448412533.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/16476i25DE132B8C9A0DDA/image-size/medium?v=v2&amp;px=400" role="button" title="Dinesh6351_0-1746448412533.png" alt="Dinesh6351_0-1746448412533.png" /></span></P><P>&nbsp;</P><P>&nbsp;</P> Mon, 05 May 2025 12:37:10 GMT https://community.databricks.com/t5/data-engineering/quota-exhaustion-issues-in-your-student-account/m-p/117700#M45550 Dinesh6351 2025-05-05T12:37:10Z https://community.databricks.com/t5/data-engineering/quota-exhaustion-issues-in-your-student-account/m-p/117722#M45553 <P>Hello&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/163358">@Dinesh6351</a>!</P> <P>This error occurs when your Azure account exceeds the available regional core quota, preventing the pipeline cluster from launching. Here, Databricks pipeline cluster attempted to use more resources than allowed. <BR />To resolve this, review the pipeline's cluster configuration and consider reducing resource usage, by selecting smaller instance types, limiting the number of worker nodes, or optimizing data processing.</P> Mon, 05 May 2025 14:28:14 GMT https://community.databricks.com/t5/data-engineering/quota-exhaustion-issues-in-your-student-account/m-p/117722#M45553 Advika 2025-05-05T14:28:14Z https://community.databricks.com/t5/data-engineering/quota-exhaustion-issues-in-your-student-account/m-p/117726#M45555 <P>Esse erro ocorre quando sua conta Azure excede a cota regional de núcleos disponíveis, impedindo a criação do cluster no Databricks. Isso significa que o cluster tentou utilizar mais recursos do que o permitido na sua região.</P><P>1-<BR />Revise a configuração do cluster da pipeline:</P><P>Vá até a aba de configuração do cluster (em "Compute" ou na definição da pipeline) e veja o tipo de instância e o número de nós.</P><P>1- Reduza o uso de recursos:</P><P>Escolha tipos de instâncias menores (por exemplo, de Standard_D4_v2 para Standard_D2_v2).</P><P>Limite o número de nós trabalhadores (workers).</P><P>Desative o autoscaling, se não for necessário, ou configure limites inferiores.</P><P>Otimize o processamento de dados:</P><P>Verifique se a pipeline pode ser dividida em partes menores.</P><P>Aplique filtros e projeções o mais cedo possível no código para reduzir o volume de dados processados.</P><P>Use select, filter e repartition de forma eficiente no Spark.</P><P>3- Solicite aumento de cota no Azure:&nbsp;</P><P><A href="https://learn.microsoft.com/pt-br/azure/quotas/quickstart-increase-quota-portal" target="_blank">https://learn.microsoft.com/pt-br/azure/quotas/quickstart-increase-quota-portal</A></P><P>Acesse o portal do Azure, vá até "Ajuda + Suporte" &gt; "Nova solicitação de suporte".</P><P>Escolha "Aumento de cota" e selecione a região e o tipo de instância desejado.</P><P>&nbsp;</P> Mon, 05 May 2025 15:00:12 GMT https://community.databricks.com/t5/data-engineering/quota-exhaustion-issues-in-your-student-account/m-p/117726#M45555 amos 2025-05-05T15:00:12Z