Alberto_Umana
Databricks Employee
Databricks Employee

The error message "Connection reset by peer" typically indicates that the connection between the client and the server was forcibly closed by the server. This can happen for various reasons, including network issues, server overload, or configuration problems.

It appears that the error occurred during the execution of a Spark job, specifically when the Python worker was trying to communicate with the JVM process.

Do you see any resource issues under cluster metrics?