cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

jwilliam
by Contributor
  • 4365 Views
  • 3 replies
  • 3 kudos

Resolved! Differences between Spark Cluster Manager and Databricks Cluster Manager?

I didn't found any documentation on Databricks Cluster Manager. Could anyone give me some resources on this topic?

  • 4365 Views
  • 3 replies
  • 3 kudos
Latest Reply
User16752242622
Valued Contributor
  • 3 kudos

Hi @John William​ Databricks clusters use Spark's Standalone cluster manager. Each Databricks cluster has its own standalone Master and Worker processes run inside of the LXC containers and share a lifecycle with the cluster. Each cluster has a singl...

  • 3 kudos
2 More Replies
Labels