Databricks

IgnacioCastinei · 09-15-2021

Hi all, So far I have been successfully using the CLI interface to upload files from my local machine to DBFS/FileStore/tables. Specifically, I have been using my terminal and the following command: databricks fs cp -r <MyLocalDataset> dbfs:/FileStor...

IgnacioCastinei · 02-27-2018

Hi all, I am using saveAsTextFile() to store the results of a Spark job in the folder dbfs:/FileStore/my_result. I can access to the different "part-xxxxx" files using the web browser, but I would like to automate the process of downloading all fil...

IgnacioCastinei · 10-30-2021

Hi @Arjun Kaimaparambil Rajan ,Thank you for your reply. Yes, I can confirm that the GUI option "Data" => "Create Table" => "Upload File" allows me to upload datasets from my local machine to DBFS. Therefore, this can be used as an alternative to t...

IgnacioCastinei · 10-12-2021

PS: I also checked the option --debug and looked for the header: x-databricks-org-id. Both the ID of the CLI and the one appearing in the GUI are the same.

IgnacioCastinei · 10-12-2021

Hi @Arjun Kaimaparambil Rajan ,Thank you for your answer. Yes, I think this is indeed the case. I can see a mismatch between the content of the DBFS when: Using my machine and the CLI (the NewDataset folder is listed when using the command "databric...

IgnacioCastinei · 10-06-2021

Hi Kaniz, Thank you so much! Its been 3 weeks since I posted the question. If you can provide me with some guidance I will appreciate it. Thank you very much in advance! Kind regards,Nacho

Databricks

User Stats

User Activity

CLI Command <databricks fs cp> Not Uploading Files to DBFS

Download a dbfs:/FileStore File to my Local Machine?

Re: CLI Command <databricks fs cp> Not Uploading Files to DBFS

Re: CLI Command <databricks fs cp> Not Uploading Files to DBFS

Re: CLI Command <databricks fs cp> Not Uploading Files to DBFS

Re: CLI Command <databricks fs cp> Not Uploading Files to DBFS