Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-20-2021 08:06 AM
if you use the multiline = true, the file will be read as a whole
(see https://docs.databricks.com/data/data-sources/read-json.html).
So if you can, try with single-line.
If that is not possible, you can try to split the json file on the storage, or use larger workers/driver.
