Dicer
Valued Contributor

Hi @anardinelli 

Thank your for your reply. This is indeed one of the solutions.

However, my driver used memory size is always not always constant. When it is doing specific code operation, it triggers the above error: Driver is up but is not responsive, likely due to GC.

My expectation is: not to run all the code operations in just one single node.

If I increase the driver memory size, do I need to increase the worker memory size as well?

Looking forward to your reply! Thank you once again!