We're experiencing the same issue on our production environment, pretty much the same error just one with 9.1 and one with 11.3 runtime versions, both LTS. The pipelines do recover on subsequent runs so looks like this is an intermittent issue, might be an issue on databricks side. Would be good to get an answer.