- 4025 Views
- 2 replies
- 2 kudos
Resolved! Understanding Partitions in Spark Local Mode
I have few fundamental questions in Spark3 while running a simple Spark app in my local mac machine (with 6 cores in total). Please help.local[*] runs my Spark application in local mode with all the cores present on my mac, correct? It also means tha...
- 4025 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
That is a lot of questions in one topic.Let's give it a try:[1] this all depends on the values of the concerning parameters and the program you run(think joins, unions, repartition etc)[2] spark.default.parallelism is by default the number of cores *...
- 2 kudos