topic Re: Reading a adls gen 2 csv file from db using standard pandas in Data Engineering

Reading a adls gen 2 csv file from db using standard pandas

riccostamendes — Tue, 31 Jan 2023 18:30:34 GMT

i have mounted the adls container where the data are, but I cannot read the files with pandas ('pd.read_csv') even though I have attached the prefix '/dbfs/' to the path . Instead if I use 'spark.read.csv', I have no problems.

Anyone knows why this is happening and how it can be fixed without altering the code ? I want to read the data with pandas.

Re: Reading a adls gen 2 csv file from db using standard pandas

riccostamendes — Wed, 01 Feb 2023 09:18:11 GMT

'file does not exist'. but the file is there in the blob and you can see it through dbutils...

Re: Reading a adls gen 2 csv file from db using standard pandas

jose_gonzalez — Thu, 23 Feb 2023 22:22:42 GMT

can you share your code? a minimal code snippet will help us.

Re: Reading a adls gen 2 csv file from db using standard pandas

Debayan — Wed, 01 Feb 2023 06:16:36 GMT

Hi, When you are not able to read the files, what is the error you get?