Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-29-2021 01:58 AM
- please try to add .option("mergeSchema", "true")
- in filePath just specify main top folder with partitions (root folder for parquet dataset)
Here is official documentation about partition discovery https://spark.apache.org/docs/2.3.1/sql-programming-guide.html#partition-discovery
My blog: https://databrickster.medium.com/
