How to increase executor memory in Databricks jobs

amitkmaurya
Contributor

May be I am new to Databricks that's why I have confusion.

Suppose I have worker memory of 64gb in Databricks job max 12 nodes...

and my job is failing due to Executor Lost due to 137 (OOM if found on internet).

So, to fix this I need to increase executor memory.

But how to increase it, choosing more workers or choosing 128gb worker? which one will work.?

Help me on this..