by
JonD
• New Contributor III
- 3622 Views
- 3 replies
- 0 kudos
Hi community,We have setup a Databricks cluster as Single node with num_workers=0 . Sometimes the cluster automatically resizes to e.g. 10 workers. When I edit the cluster subsequently it gives an error that num_workers is not allowed for Single node...
- 3622 Views
- 3 replies
- 0 kudos
Latest Reply
I think the issue is solved, at least it didn't occur in the last month. We monitored this via Azure Log Analytics. Maybe it was solved due to some patch/update, thanks anyway!
2 More Replies
- 1489 Views
- 2 replies
- 0 kudos
Is there any way to change public ip of driver node? when I try to launch two different instance (single node), I see those two machine have the same public ip.I'm writing this command into notebook of each instance. I got the same ip.from requests i...
- 1489 Views
- 2 replies
- 0 kudos
Latest Reply
Hi @Hakan Tekbas Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
1 More Replies
- 5694 Views
- 6 replies
- 4 kudos
I am learning Pyspark on Community edition for a like month. It's been great until I am facing issues while creating a cluster for 3-4 Days.Sometimes it is taking 30 minutes to 60 minutes to create a Cluster and sometimes it is not even creating a Cl...
- 5694 Views
- 6 replies
- 4 kudos
Latest Reply
@Dileep Vidyadara - If your question was fully answered by @Hubert Dudek, would you be happy to mark his answer as best?
5 More Replies
- 1418 Views
- 1 replies
- 1 kudos
Yes you can create a "Single Node" Cluster, https://docs.databricks.com/clusters/single-node.html . It is currently not recommended to use "Single Node" cluster for streaming workloads
- 1418 Views
- 1 replies
- 1 kudos
Latest Reply
Single Node clusters should not be used for production workloads involving streaming queries, or complex computations. The intention here is to bring up the Spark cluster for all kinds of workloads
- 8029 Views
- 1 replies
- 0 kudos
I see that single node is a cluster mode option that I have when creating clusters. When should I use this compared to the standard mode?
- 8029 Views
- 1 replies
- 0 kudos
Latest Reply
Single-node, like the name implies, is a single machine. It still has Spark, just a local cluster. This is a good choice if you are running a workload that does not use Spark, or only needs it for data access. One good example is a small deep learnin...
