Working with Pandas through Abfss
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-22-2025 10:34 PM
Hi,
I am unable to read and write pandas datframe through abfss protocol , Is there a work around for this , I do not want to store my files in dbfs
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-22-2025 11:59 PM
Hi @pradeepvatsvk ,
It's well known limitation. The pandas dataframe does not support that protocol. Below you can find some workarounds:
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-23-2025 12:37 AM
you can use volumes and mount the abfss location to unity catalog and can access the files present in azure in databricks.
Regards,
Avinash N
