der
Valued Contributor

Today I see the issue again on a dedicated cluster with DBR 18.1 with deactivated DBFS on workspace level 

Accessing File with Python result into: 

FileNotFoundError: [Errno 2] No such file or directory

Both subprocess run can access main folder "base" and the config.json "file" 

dmesg command does not work (even with sudo)

sudo dmesg | tail -n 50 || true
dmesg: read kernel buffer failed: Operation not permitted

 dbutils works too

dbutils.fs.ls("file:/Workspace/Users/<USER>")

and also native listing of the directory works

import os
files = os.listdir("/Workspace/Users/<USER>")

So it looks for me like there is something wrong or not working in /databricks/python/lib/python3.12/site-packages/IPython/core/interactiveshell.py with workspace files

File /databricks/python/lib/python3.12/site-packages/IPython/core/interactiveshell.py:324, in _modified_open(file, *args, **kwargs)
    317 if file in {0, 1, 2}:
    318     raise ValueError(
    319         f"IPython won't let you open fd={file} by default "
    320         "as it is likely to crash IPython. If you know what you are doing, "
    321         "you can use builtins' open."
    322     )
--> 324 return io_open(file, *args, **kwargs)