โ01-17-2022 02:57 AM
Hi Folks,
I have installed and configured databricks CLI in my local machine. I tried to move a local file from my personal computer using dbfs cp to dbfs:/ path. I can see the file is copied from local, and is only visible in local. I am not able to see it in dbfs cluster via databricks UI.
Local
I'm trying to list the data in cluster. It is not available .
โ02-01-2022 02:08 AM
Hi @Thulasitharan Govindarajโ ,
The DBFS command-line interface (CLI) uses the DBFS API to expose an easy to use the command-line interface to DBFS. Using this client, you can interact with DBFS using commands similar to those you use on a Unix command line. For example:
# List files in DBFS
dbfs ls
# Put local file ./apple.txt to dbfs:/apple.txt
dbfs cp ./apple.txt dbfs:/apple.txt
# Get dbfs:/apple.txt and save to local file ./apple.txt
dbfs cp dbfs:/apple.txt ./apple.txt
# Recursively put local dir ./banana to dbfs:/banana
dbfs cp -r ./banana dbfs:/banana
โ01-17-2022 03:18 AM
โ01-17-2022 08:57 PM
I tried databricks fs cp too @Hubert Dudekโ , still the issue exists. Any Idea why?
โ01-18-2022 11:50 AM
โ01-23-2022 06:19 AM
โ01-29-2022 06:12 AM
โ01-31-2022 02:01 AM
Hi @Thulasitharan Govindarajโ , Does the issue persist or is it resolved?
โ01-31-2022 05:36 AM
Issue still exists @Kaniz Fatmaโ
โ02-01-2022 02:08 AM
Hi @Thulasitharan Govindarajโ ,
The DBFS command-line interface (CLI) uses the DBFS API to expose an easy to use the command-line interface to DBFS. Using this client, you can interact with DBFS using commands similar to those you use on a Unix command line. For example:
# List files in DBFS
dbfs ls
# Put local file ./apple.txt to dbfs:/apple.txt
dbfs cp ./apple.txt dbfs:/apple.txt
# Get dbfs:/apple.txt and save to local file ./apple.txt
dbfs cp dbfs:/apple.txt ./apple.txt
# Recursively put local dir ./banana to dbfs:/banana
dbfs cp -r ./banana dbfs:/banana
โ02-07-2022 07:36 AM
Hi @Thulasitharan Govindarajโ , Were you able to resolve your problem through the solution I provided above?
โ02-07-2022 08:34 AM
No, @Kaniz. The syntax I was using is the same as you have mentioned. I still am not able to see the file which I copied from local to dbfs in databricks front-end
โ03-11-2022 02:03 AM
Hi @Thulasitharan Govindarajโ , Did you install and configure Azure Databricks CLI properly? Would you mind trying again?
โ03-11-2022 06:46 AM
Hi @Thulasitharan Govindarajโ , What is the size of the file which you're trying to copy from the local to dbfs?
โ03-08-2022 04:10 AM
Hi, Could you try to save the file from your local machine to dbfs:/FileStore location?
# Put local file test.py to dbfs:/FileStore/test.py
dbfs cp test.py dbfs:/FileStore/test.py
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.