- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-30-2021 07:35 AM
Hi @Arjun Kaimaparambil Rajan ,
Thank you for your reply.
Yes, I can confirm that the GUI option "Data" => "Create Table" => "Upload File" allows me to upload datasets from my local machine to DBFS.
Therefore, this can be used as an alternative to the CLI "databricks fs cp" command for uploading datasets from the local machine to DBSF /FileStore/tables/.
Two questions:
1. Would there be a similar GUI approach to download a result folder produced by a Spark Job back to the local machine?
I am aware that individual files in /FileStore/tables can be accessed via the URL, but this approach doesn't seem to work for an entire folder. Whereas the command "databricks fs ls" can be used to generate a script iterating the download of each file via "wget", that seems to be quite tedious.
2. More in general, would it be possible to add the CLI functionality "databricks fs cp" back to the Databricks Community Edition?
The CLI "databricks fs cp" command has been working all these years until recently. Perhaps it could be considered to bring this functionality back.
Personally, I use Databricks for teaching Spark in my university modules. Both my students and I like Databricks so much, and we would like to continue using it.
Kind regards,
Nacho