This video shows how the number of cores influence the created spark partitions when using spark.range or spark.createDataFrame. It also shows how the number of partitions influence the spark execution performance. Feel free to comment or challenge my explenations as always. Happy to learn also ...