szymon_dybczak
Esteemed Contributor III

You should look at Spark Web UI and investigate information there.There could be several causes of this like:

- skewed data

- memory issues

- shuffling data