topic Re: How can I delete folders from my DBFS? in Data Engineering

How can I delete folders from my DBFS?

Mir_SakhawatHos — Wed, 30 Aug 2017 07:49:20 GMT

I want to delete my created folder from DBFS. But how? How can I download files from there?

__max — Wed, 30 Aug 2017 08:42:36 GMT

Hello,

Please, take a look at the documentation:

To delete created folder in notebooks:

%fs rm -r foobar

To download files, please, use dbfs:

# Get dbfs:/apple.txt and save to local file ./apple.txt
dbfs cp -r dbfs:/src ./dst

The tool could be installed via:

pip install --upgrade databricks-cli

Best regards,

Maxim Gekk

IA — Thu, 02 Jul 2020 13:13:08 GMT

Hello,

Max answer focuses on the CLI. Instead, using the Community Edition Platform, proceed as follows:

# You must first delete all files in your folder.

1. import org.apache.hadoop.fs.{Path, FileSystem}

2. dbutils.fs.rm("/FileStore/tables/file.csv")

You can refresh DBFS each time you proceed to action above for checking is the file was deleted.

When all files are deleted then you can delete the folder using the same command (2.).

Good luck.