How can I delete folders from my DBFS?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-30-2017 12:49 AM
I want to delete my created folder from DBFS. But how? How can I download files from there?
- Labels:
-
DBFS
-
Download files
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-30-2017 01:42 AM
Hello,
Please, take a look at the documentation:
https://docs.databricks.com/user-guide/dbfs-databricks-file-system.html#dbfs-command-line-interface
To delete created folder in notebooks:
%fs rm -r foobar
To download files, please, use dbfs:
# Get dbfs:/apple.txt and save to local file ./apple.txt
dbfs cp -r dbfs:/src ./dst
The tool could be installed via:
pip install --upgrade databricks-cli
Best regards,
Maxim Gekk
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-02-2020 06:13 AM
Hello,
Max answer focuses on the CLI. Instead, using the Community Edition Platform, proceed as follows:
# You must first delete all files in your folder.
1. import org.apache.hadoop.fs.{Path, FileSystem}
2. dbutils.fs.rm("/FileStore/tables/file.csv")
You can refresh DBFS each time you proceed to action above for checking is the file was deleted.
When all files are deleted then you can delete the folder using the same command (2.).
Good luck.