cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

When should I use single node clusters vs standard?

User16826992666
Valued Contributor

I see that single node is a cluster mode option that I have when creating clusters. When should I use this compared to the standard mode?

1 ACCEPTED SOLUTION

Accepted Solutions

sean_owen
Honored Contributor II
Honored Contributor II

Single-node, like the name implies, is a single machine. It still has Spark, just a local cluster. This is a good choice if you are running a workload that does not use Spark, or only needs it for data access. One good example is a small deep learning job. Often it's most efficient and easiest to use one machine with multiple GPUs rather than try to distribute on a cluster.

View solution in original post

1 REPLY 1

sean_owen
Honored Contributor II
Honored Contributor II

Single-node, like the name implies, is a single machine. It still has Spark, just a local cluster. This is a good choice if you are running a workload that does not use Spark, or only needs it for data access. One good example is a small deep learning job. Often it's most efficient and easiest to use one machine with multiple GPUs rather than try to distribute on a cluster.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.