We need to understand, why upstream of the repl cancelled the request. It could be resource exhaustion. Do you see "java.lang.OutOfMemoryError"? 

I saw https://issues.apache.org/jira/browse/SPARK-49492 to be the cause of such an error in one of the past issues.

Do you regularly see this issue, or is intermittent? Restart of the cluster will cause the issue to be mitigated, but to get review the logs you may have to enable cluster log delivery to investigate further.