Driver is up but is not responsive, likely due to GC.
Hi all, "Driver is up but is not responsive, likely due to GC." This is the message in cluster event logs. Can anyone help me with this. What does GC means? Garbage collection? Can we control it externally?
- 37268 Views
- 5 replies
- 2 kudos
Latest Reply
9/10 times GC is due to out of memory exceptions.@Jaron spark.catalog.clearCache() is not a configurable option, but rather a command to submit.
- 2 kudos