When should I use single node clusters vs standard?

User16826992666 — Tue, 15 Jun 2021 20:25:35 GMT

I see that single node is a cluster mode option that I have when creating clusters. When should I use this compared to the standard mode?

Re: When should I use single node clusters vs standard?

sean_owen — Thu, 17 Jun 2021 23:09:17 GMT

Single-node, like the name implies, is a single machine. It still has Spark, just a local cluster. This is a good choice if you are running a workload that does not use Spark, or only needs it for data access. One good example is a small deep learning job. Often it's most efficient and easiest to use one machine with multiple GPUs rather than try to distribute on a cluster.

topic When should I use single node clusters vs standard? in Data Engineering

When should I use single node clusters vs standard?

Re: When should I use single node clusters vs standard?