Facing CANNOT_OPEN_SOCKET error after job cluster fails to upsacle to target nodes

ashishCh
New Contributor II

Screenshot 2025-11-25 at 6.08.19 PM.png
This error pops up in my Databricks workflow 1 out of 10 times, and everytime it occurs I see the below message in event logs.
 Compute upsize complete, but below target size. The current worker count is 1, out of a target of 3.


And right after this my job cluster terminates with the socket error message.

Screenshot 2025-11-25 at 6.10.50 PM.png

These are my cluster configs, if required.

Screenshot 2025-11-25 at 6.12.30 PM.png