Shalabh007
Honored Contributor

Directly jumping on solution to inc the cluster size is not advisible. I found this nicely written blog what could be potential reason and some initial steps to resolve the OOM error in spark.

https://medium.com/swlh/spark-oom-error-closeup-462c7a01709d