much appreciate. Lastly before closing, is not overhead memory outside of spark.executor.memory (7.6GB) ? If spark.executor.memory is 7.6GB, is this dedicatedly for storage/execution with some reserved? Because 16 GB is total memory per machine, out of this 7.6GB is spark.executor.memory. So difference (16-7.6GB) would be for off heap.