topic Re: Not able to move files from local to dbfs through dbfs CLI in Data Engineering

Not able to move files from local to dbfs through dbfs CLI

study_community — Mon, 17 Jan 2022 10:57:32 GMT

Hi Folks,

I have installed and configured databricks CLI in my local machine. I tried to move a local file from my personal computer using dbfs cp to dbfs:/ path. I can see the file is copied from local, and is only visible in local. I am not able to see it in dbfs cluster via databricks UI.

Local

I'm trying to list the data in cluster. It is not available .

Re: Not able to move files from local to dbfs through dbfs CLI

Hubert-Dudek — Mon, 17 Jan 2022 11:18:06 GMT

for cli command is "databricks fs cp" to copy from local storage to cluster

Re: Not able to move files from local to dbfs through dbfs CLI

study_community — Tue, 18 Jan 2022 04:57:18 GMT

I tried databricks fs cp too @Hubert Dudek , still the issue exists. Any Idea why?

Re: Not able to move files from local to dbfs through dbfs CLI

Hubert-Dudek — Tue, 18 Jan 2022 19:50:54 GMT

What distribution are you using (community, Azur?)

can you verify your connection using databricks fs ls

do you see there typical folders like user, tmp etc?

Re: Not able to move files from local to dbfs through dbfs CLI

study_community — Sun, 23 Jan 2022 14:19:02 GMT

Hi @Hubert Dudek , I am using community edition with AWS in the backend.

If I do databricks fs ls, I only am able to see one folder, databricks-results

Re: Not able to move files from local to dbfs through dbfs CLI

study_community — Sat, 29 Jan 2022 14:12:41 GMT

Okay Sure. I'll use upload then

Re: Not able to move files from local to dbfs through dbfs CLI

study_community — Mon, 31 Jan 2022 13:36:23 GMT

Issue still exists @Kaniz Fatma

Re: Not able to move files from local to dbfs through dbfs CLI

study_community — Mon, 07 Feb 2022 16:34:09 GMT

No, @Kaniz. The syntax I was using is the same as you have mentioned. I still am not able to see the file which I copied from local to dbfs in databricks front-end

Re: Not able to move files from local to dbfs through dbfs CLI

Anonymous — Tue, 08 Mar 2022 12:10:58 GMT

Hi, Could you try to save the file from your local machine to dbfs:/FileStore location?

# Put local file test.py to dbfs:/FileStore/test.py

dbfs cp test.py dbfs:/FileStore/test.py