topic Re: Unable to read available file after downloading in Get Started Discussions

Unable to read available file after downloading

sharma_kamal — Sun, 07 Apr 2024 05:54:15 GMT

After downloading a file using `wget`, I'm attempting to read it by spark.read.json.

I am getting error:

PATH_NOT_FOUND - Path does not exist: dbfs:/tmp/data.json. SQLSTATE: 42K03

File <command-3327713714752929>, line 2

I have checked the file do exist. I attempted to copy the file to DBFS, but encountered difficulties.
Attaching relevant screenshots here.

Could someone please help me identify any errors or issues in my approach?

Thank you.

ThomazRossito — Sun, 07 Apr 2024 16:49:21 GMT

Hi,

Perform a test with the code below

Code layout:
dbutils.fs.cp("file:///<file source directory>/<your file extension>", "dbfs:/<file destination directory>/", True)

Code example:

dbutils.fs.cp("file:///tmp/file.csv", "dbfs:/tmp/", True)

Ayushi_Suthar — Mon, 08 Apr 2024 06:02:53 GMT

Hi @sharma_kamal , Good Day!

Could you please try the below code suggested by @ThomazRossito , it will help you.

Also please refer to the below document to work with the files on Databricks:

Please let me know if this helps and leave a like if you find this information useful. Follow-ups are appreciated.
Kudos
Ayushi

sharma_kamal — Tue, 09 Apr 2024 15:45:52 GMT

Thank you. It worked!