Hello all @James Smith​ @Atiquzzaman Ankur​  @Kaniz Fatma​ ,

I am facing the exact same issue and do not know how to solve it. I tried freeing up some memory, But the problem persists. Please look at some of my screenshots.

It would be great if one of you could point me in the correct direction. I checked my memory consumption on driver node and I observed that it is maxing out for a short while. But I don't think this is the cause for failure as I have observed this multiple times before and the code still ran successfully without any error.

Best regards,

Akshay