Understanding Serverless Compute Sharing Across Notebooks in Databricks

Akshay_Petkar
Valued Contributor

Hi Community,

I am using Databricks Serverless compute in notebooks. When I create multiple notebooks and choose Serverless as the compute, I noticed that I can select the same serverless cluster for all of them.

This brings up a few questions:

  1. Is this serverless compute shared across all notebooks (and users), or does each notebook/user get a separate compute instance behind the scenes?

  2. If it is shared, is there a max limit on CPU cores or concurrency for the serverless compute engine?

  3. How does Databricks handle auto-scaling or resource isolation when multiple users are running queries using the same serverless compute?

Thanks in advance for the clarification!

Akshay Petkar