Long time has passed and I have a solution to get things working. I do have the logs, but haven't really paid much attention to this lately.

To me, this is a regression issue in Azure Databricks. When a new version of a node is released, it should be tested with containers too. If old node versions are not, maybe I should be informed about it.