This is an expensive and long-running job that gets about halfway done before failing. The stack trace is included below, but here is the salient part:
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 4881 in stage...
