Every now and then, we get the following error in job cluster runs (when opening a workspace file):
OSError: [Errno 5] Input/output error: '/Workspace/Users/<uuid>/.bundle/<path>'
This happens even though the Python notebook (which is also in workspace files) seems to have loaded fine. It's happening on the driver.
On Databricks, logs are so full of framework-level warnings and errors that it's impossible to make sense of this error in terms of other information.
Why would this happen, is it something that Databricks is monitoring and aware of?