Does Databricks run it's own compute clusters?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-26-2025 03:28 AM
Rather new to Databricks so I understand this might be a silly question, but from what I understand so far Databricks leverages Spark for parallelized computation-but when we create a compute is it using the compute power from whatever cloud provider we connected? (i.e. AWS EC2,GCP Compute Engine) If so would love to hear a little more about how that works or get pointed to an article/video that dives deeper into it!
- Labels:
-
Compute Instances
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-26-2025 03:59 AM
Hello billyboy,
You can start it off by looking in their official architecture documentation: https://learn.microsoft.com/en-us/azure/databricks/getting-started/overview
And next this is the article I like, that goes in more details: https://www.accentfuture.com/databricks-architecture-overview/
Best, Ilir