Spark VCore for Databrick vCPU

Phani1 — Wed, 07 Feb 2024 07:18:02 GMT

Hi Team,

What is the equivalent Spark VCore for Databrick vCPU? , like for below example for DS3 v2 , vCPU=4 and RAM = 14.00 GiB, would like to know equivalent Spark VCore for DS3 v2 as in Azure Databricks Pricing | Microsoft Azure

Regards,

Phanindra

Re: Spark VCore for Databrick vCPU

Yeshwanth — Wed, 07 Feb 2024 08:02:24 GMT

@Phani1 In Databricks, the vCPU count is equivalent to the number of Spark vCores. This means that if the DS3 v2 instance has 4 vCPU, it would also have 4 Spark vCores. Please note that the Spark VCore count is based on the vCPU count of the underlying cloud provider's instance type. Spark tasks are distributed across these vCores for processing.

I hope this answers your question.

topic Re: Spark VCore for Databrick vCPU in Get Started Discussions

Spark VCore for Databrick vCPU

Re: Spark VCore for Databrick vCPU