06-13-2022 11:21 PM
How do I change the vCPU type for SQL Endpoint on Azure Databricks? Currently it picks as default DSv4 CPUs which reaches its quota limit although I have unused quota in other vCPU types. I faced similar issue while using Delta live tables but I was able to change CPU type in the json description during creation and that worked for me. Also I am using the premium edition of Azure Databricks.
Edit: On Azure Databricks the default vCPU type is EDSv4(not DSv4 as I mentioned above) as I read on Azure documentation. So even for the smallest cluster for Databricks SQL endpoint requires 16 vCPUs of this type(8 for driver + 8 for worker). I don't know why the requirement would be so high even for testing and relegated to such a specific vCPU type.
06-15-2022 11:52 PM
Hi @Tarique Anwar , I don't think changing the vCPU type, for now, is possible. However, I can check with the product team on this.
https://docs.microsoft.com/en-us/azure/databricks//sql/admin/sql-endpoints#required-azure-vcpu-quota
06-15-2022 11:55 PM
@Bilal Aslam your input on this, please.
06-17-2022 03:17 AM
06-17-2022 04:45 AM
And the minimum spec that we can create used 16 cores and no way to create with less cores than that?
06-18-2022 12:43 AM
@Tarique Anwar there are two options:
06-19-2022 09:55 PM
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.