topic [Errno 2] No such file or directory in Data Engineering

[Errno 2] No such file or directory

otum — Thu, 11 Jan 2024 05:14:06 GMT

I am reading a Json a file as in below location, using the below code,

file_path = "/dbfs/mnt/platform-data/temp/ComplexJSON/sample.json" # replace with the file path f = open(file_path, "r") print(f.read())

but it is failing for no such file or directory exists?

Can someone please help me with the issue?

shan_chandra — Thu, 11 Jan 2024 16:38:41 GMT

Hi @otum , can you please try to cat the file first and validate if you are able to view the data first

%sh cat /dbfs/FileStore/babynames.csv

I was able to run the same commands as you and read the files.

Thanks,

Shan

Debayan — Thu, 11 Jan 2024 16:45:04 GMT

Hi, Could you please try with dbfs:/ ? Also, could you please ls the absolute file path to see what's the content?

otum — Thu, 11 Jan 2024 23:10:38 GMT

it isn't displaying with sh cat, but displaying with dbutils.fs.ls

Please find below is the image,

otum — Thu, 11 Jan 2024 23:14:57 GMT

Thanks for the reply, here is what I am getting when tried with dbfs:/

shan_chandra — Tue, 16 Jan 2024 15:54:56 GMT

@otum cat command should be given as below (not syntax verified).

%sh cat /dbfs/mnt/platform-data/temp/ComplexJSON/sample.json

Debayan — Thu, 18 Jan 2024 18:51:00 GMT

Hi, As Shan mentioned, could you please cat the file and see if it exists.