I increased the minimum amount of worker out of 8 from 2 to 7.

(1) I see this under Stages in Spark UI, doesn't look to show a data spill. imageThen in the SQL tab, its just blank:

image 

This is as far as I got for now before the Spark UI tab itself is just blank and not loading anything.

image