Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-16-2024 08:34 AM - edited 10-16-2024 08:35 AM
spark solution worked
instead of
df = pd.read_parquet(path = datasource_path.replace("dbfs:/", '/dbfs/'))
I used
spark_df = spark.read.parquet("dbfs:/mnt/dbacademy-datasets/data-engineer-learning-path/v04/ecommerce/raw/users-historical/")
# Convert to pandas
DataFrame df = spark_df.toPandas()
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-24-2024 11:45 PM
Thanks for sharing bro ..It really helped.