Did the SparkUI training yesterday with Mark Ott, and I highly recommend it. It was super helpful and provided a lot of clarity around some of the vaguer terms and metrics, and some surprise penalties.
In-memory partition size is the the main thing to check out! Shoot for 128M - 1024M. But take Mark's class!
