uzairm
Databricks Partner

I have identified the issue. The driver memory is exhausting and the worker nodes are not coming into play...

View solution in original post