How is Serverless Compute implemented under the hood?

Administration & Architecture

Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.

Hi everyone,

I've been reading about Serverless Compute and have a question about the underlying architecture.
In the classic compute model, clusters are provisioned in the customer's cloud account. With Serverless, Databricks manages the compute, but I'm trying to understand what that actually means under the hood.

Is Serverless still running on Azure/AWS/GCP VMs that Databricks manages in its own cloud account, or is there a different execution model behind it? Also, how is compute isolated across tenants while keeping startup times so low?

I couldn't find much detail beyond the high-level architecture in the documentation. If anyone knows of an engineering blog, Summit session, or technical deep dive that explains this, I'd appreciate the reference.

Thanks!