Hi,
In the course Introduction to Apache Spark; according to Apache Spark Runtime Architecture; Page 6 of 15. It says that :
- The cluster manager allocates resources and assigns tasks......
- Workers perform tasks assigned by the driver
Can you help me please ? I'm so confuse. Which one assigns tasks to the workers ?
Hi @fundat
Perhaps the picture is useful here:
Give this blog a read, I think this will answer some of your questions: https://medium.com/@knoldus/understanding-the-working-of-spark-driver-and-executor-4fec0e669399 😀.
All the best,
BS
On Medium, anyone can share insightful perspectives, useful knowledge, and life wisdom with the world.
