topic Re: How can I delete a file in DBFS with Illegal character? in Data Engineering

How can I delete a file in DBFS with Illegal character?

aline_alvarez — Wed, 08 Feb 2023 12:07:05 GMT

How can I delete a file in DBFS with Illegal character?

Someone put the file named "planejamento_[4098.]___SHORT_SAIA_JEANS__.xlsx" inside the folder /FileStore and I can delete it, because of this error: java.net.URISyntaxException: Illegal character in path at index 24.

I used: dbutils.fs.rm("/FileStore/planejamento_[4098.]___SHORT_SAIA_JEANS__.xlsx")

Re: How can I delete a file in DBFS with Illegal character?

-werners- — Wed, 08 Feb 2023 12:49:28 GMT

you can try to use the %sh magic command and use rm.

Combined with this little help, it will probably work.

Re: How can I delete a file in DBFS with Illegal character?

aline_alvarez — Thu, 16 Feb 2023 12:39:19 GMT

Thank you. I tried all the commands but none of them worked because the characters are "[" and "]". 😩

Re: How can I delete a file in DBFS with Illegal character?

-werners- — Thu, 16 Feb 2023 13:00:50 GMT

it should still be possible.

can you try using ls -li (or ls -ia) first to get a list of files, then use the inode number (first column) and use it in the find- delete command:

> ls -li

> find . -inum <inodenumber> -delete

you can try without the -delete first to see if the file can be found

Re: How can I delete a file in DBFS with Illegal character?

aline_alvarez — Thu, 16 Feb 2023 20:13:47 GMT

The file is in DBFS and doesn't show it with ls -li.

Re: How can I delete a file in DBFS with Illegal character?

-werners- — Fri, 17 Feb 2023 12:23:51 GMT

try this

%sh

ls -li /dbfs

if the file is located in a subdirectory you can change the path mentioned above.

the %sh magic command gives you access to linux shell commands.

Re: How can I delete a file in DBFS with Illegal character?

aline_alvarez — Fri, 17 Feb 2023 12:39:39 GMT

Thank you!

It worked out!