03-13-2020 01:53 AM
Hi all,
"Driver is up but is not responsive, likely due to GC."
This is the message in cluster event logs. Can anyone help me with this. What does GC means? Garbage collection? Can we control it externally?
03-17-2020 12:59 PM
Hi @vamsivarun007,
11-25-2020 11:57 PM
spark.catalog.clearCache() solve the problem for me 😉
never-displayed
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.