i am trying to read csv file using databricks, i am getting error like ......FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/FileStore/tables/world_bank.csv'

[Venky]

i am trying to read csv file using databricks, i am getting error like ......FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/FileStore/tables/world_bank.csv'

[-werners-]

This means the path to the file you typed is not valid, the file is not there.

Can you check in the Data/DBFS page if the file is there (or via dbutils.fs.ls)?

[Venky]

No, file path is correct

[Kaniz]

Hi @Venky D​ ,

Given that the file path is correct, the code runs well.

[Kaniz]

Hi @Venky D​ , Were you able to read your CSV file using databricks?

[KumarPalle]

I am wondering how it worked for you. I have tried the same steps and no

luck. using dbutils i am finding file but when i read using pandas its saying no such file or directory exists.

dbutils.fs.ls("FileStore/shared_uploads/kumarpalle/Covid19Europedata.csv")

 

Please help here. uploaded the same file that am working on.

Also, please check if you have applied any settings that we are missing.

[Alexis]

Hi Kumar,

you're almost there, try this:

df1 = pd.read_csv("/dbfs/FileStore/shared_uploads/kumarpalle/Covid19Europedata.csv")

df1.describe()

Cheers!

[KumarPalle]

Hi @Alexis​ ,

Thanks for quick response. It above method didn't worked but reading using spark and appending to Pandas it worked.

Here are the steps that i followed.

df1 = spark.read.format("csv").option("header", "true").load("dbfs:/FileStore/shared_uploads/kumarpalle/Covid19Europedata-1.csv").toPandas()

df1.head()

 

[KumarPalle]

@Venky D​ Please follow the above steps to read using Spark as pandas doesn't work through dbfs.  

[Tico23]

same issue here... .toPandas() was also my only solution... otherwise error!

[SanchesSan]

I did the same as you, but the reading does not work.

Can you help me? thanks

[Venky]

Please help me on this error

[-werners-]

can you try without the dbfs part?

so /Filestore/tables/world_bank.csv

[Venky]

it's not working

[Kaniz]

Hi @Venky D​ , Is it working now?