DLT | Communication lost with driver | Cluster was not reachable for 120 seconds

mkwparth
Databricks Partner

Hey Community, 

I'm facing this error, It says that "com.databricks.pipelines.common.errors.deployment.DeploymentException: Communication lost with driver. Cluster 1030-205818-yu28ft9s was not reachable for 120 seconds" 

mkwparth_0-1761892686441.png

This issue occurred in production, but after re-running the job, it worked fine. I'm unable to figure out why it happens intermittently -  it’s quite a strange and inconsistent error. Has anyone else experienced something similar or knows what might be causing it?