Course - Introduction to Apache Spark

[fundat]

Hi,

In the course Introduction to Apache Spark; according to Apache Spark Runtime Architecture; Page 6 of 15. It says that :

• The cluster manager allocates resources and assigns tasks......
• Workers perform tasks assigned by the driver

Can you help me please ? I'm so confuse. Which one assigns tasks to the workers ?

 

[BS_THE_ANALYST · Accepted solution]

Hi @fundat 

Perhaps the picture is useful here:

Give this blog a read, I think this will answer some of your questions: https://medium.com/@knoldus/understanding-the-working-of-spark-driver-and-executor-4fec0e669399 😀.

All the best,
BS

[fundat]

Hi @BS_THE_ANALYST ,

Thank you so much. I understand.