Working with Pandas through Abfss

[pradeepvatsvk]

Hi, 

I am unable to read and write pandas datframe through abfss protocol , Is there a work around for this , I do not want to store my files in dbfs

[szymon_dybczak]

Hi @pradeepvatsvk ,

It's well known limitation. The pandas dataframe does not support that protocol. Below you can find some workarounds:

https://stackoverflow.com/questions/72204477/databricks-pyspark-pandas-dataframe-to-excel-does-not-r...

[Avinash_Narala]

you can use volumes and mount the abfss location to unity catalog and can access the files present in azure in databricks.

Regards,

Avinash N