cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Not able to move files from local to dbfs through dbfs CLI

study_community
New Contributor III

Hi Folks,

I have installed and configured databricks CLI in my local machine. I tried to move a local file from my personal computer using dbfs cp to dbfs:/ path. I can see the file is copied from local, and is only visible in local. I am not able to see it in dbfs cluster via databricks UI.

image 

Local

I'm trying to list the data in cluster. It is not available .

image 

8 REPLIES 8

Hubert-Dudek
Esteemed Contributor III

for cli command is "databricks fs cp" to copy from local storage to cluster

image.png

study_community
New Contributor III

I tried databricks fs cp too @Hubert Dudek​  , still the issue exists. Any Idea why?

Hubert-Dudek
Esteemed Contributor III

What distribution are you using (community, Azur?)

can you verify your connection using databricks fs ls

do you see there typical folders like user, tmp etc?

image.png

Hi @Hubert Dudek​  , I am using community edition with AWS in the backend.

If I do databricks fs ls, I only am able to see one folder, databricks-results

image 

Okay Sure. I'll use upload then

Issue still exists @Kaniz Fatma​ 

No, @Kaniz. The syntax I was using is the same as you have mentioned. I still am not able to see the file which I copied from local to dbfs in databricks front-end

Anonymous
Not applicable

Hi, Could you try to save the file from your local machine to dbfs:/FileStore location?

# Put local file test.py to dbfs:/FileStore/test.py

dbfs cp test.py dbfs:/FileStore/test.py

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group