Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-25-2022 10:59 PM
did you enable the multiline option while reading the json, because that could be the cause?
See also here.
If you can, try with single-line format. Because then you can really leverage the parallel processing power of spark.