Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-23-2022 01:12 PM
Pandas will not see dbfs storage this way. You need to change to pandas on spark or use the classic path.
import pyspark.pandas as pd
pd.read_csv("dbfs:/your_path/your_file.csv")
import pandas as pd
pd.read_csv("/dbfs/your_path/your_file.csv")
My blog: https://databrickster.medium.com/