com.databricks.backend.common.rpc.DriverStoppedException

[ac567]

com.databricks.backend.common.rpc.DriverStoppedException: Driver down cause: driver state change (exit code: 143)

facing this cluster issue while i deploy and run my workflow through asset bundle. i have tried everything to update in spark configuration in asset bundle but exact cause is unknown.

[Alberto_Umana]

Hello @ac567,

The error message "com.databricks.backend.common.rpc.DriverStoppedException: Driver down cause: driver state change (exit code: 143)" typically indicates that the driver process was terminated due to an Out of Memory (OOM) condition. This is similar to the exit code 137, which also signifies an OOM error.

Have you validated driver logs of the cluster?

[ac567 · Accepted solution]

i have increased driver memory and it worked. thanks for reply

[Alberto_Umana]

Awesome, good to hear!