Does Databricks run it's own compute clusters?

billyboy
New Contributor II

Rather new to Databricks so I understand this might be a silly question, but from what I understand so far Databricks leverages Spark for parallelized computation-but when we create a compute is it using the compute power from whatever cloud provider we connected? (i.e. AWS EC2,GCP Compute Engine) If so would love to hear a little more about how that works or get pointed to an article/video that dives deeper into it!

ilir_nuredini
Honored Contributor

Hello billyboy,

You can start it off by looking in their official architecture documentation: https://learn.microsoft.com/en-us/azure/databricks/getting-started/overview
And next this is the article I like, that goes in more details: https://www.accentfuture.com/databricks-architecture-overview/

Best, Ilir