- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2018 03:15 PM
Hi all,
I am using saveAsTextFile() to store the results of a Spark job in the folder dbfs:/FileStore/my_result.
I can access to the different "part-xxxxx" files using the web browser, but I would like to automate the process of downloading all files to my local machine.
I have tried to use cURL, but I can't find the RestAPI command to download a dbfs:/FileStore file.
Question: How can I download a dbfs:/FileStore file to my Local Machine?
I am using Databricks Community Edition to teach an undergraduate module in Big Data Analytics in college. I have Windows 7 installed in my local machine. I have checked that cURL and the _netrc files are properly installed and configured as I manage to successfully run some of the commands provided by the RestAPI.
Thank you very much in advance for your help!
Best regards,
Nacho
- Labels:
-
Command execution
-
DBFS
-
Rest-api