Cannot delete file in dbfs

erigaud — Fri, 11 Aug 2023 13:58:49 GMT

Hello,

I am trying to delete a folder in /dbfs/mnt, but I am unable to do so. The folder was an old mounted storage account, which was deleted. The folder contains a single file 'mount.err'.

In command line I tried rm -rf my_folder, with and without sudo. I also tried to rename the folder.

Whatever I try, I get the following error : rm: cannot remove 'my_folder/mount.err': Input/output error

I also tried in a notebook and with dbutils, but one again without success.

I tried repairing the filesystem with fsck.ext4, without success.

Please let me know if someone has a solution, thank you.

Re: Cannot delete file in dbfs

erigaud — Thu, 24 Aug 2023 06:11:40 GMT

Hello,

Thanks for the answer !

The problem was indeed coming from a broken mount point. After running the refreshMounts() command, I still was not able to remove the folder, because the command was throwing a NullPointerException. However I was able to run the dbutils.fs.unmount command on the broken folder (even though before it did not work and the folder was not showing up when I was trying to list all the mounts.

After running the unmount command I was able to delete the folder just fine. Thank you !

topic Re: Cannot delete file in dbfs in Data Engineering

Cannot delete file in dbfs

Re: Cannot delete file in dbfs