Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-16-2023 10:33 AM
You're having trouble with the csv file. If there is a return character in the text, it thinks it's a new line and new record. You'll want to use the option multiline = True.
Here are the docs https://spark.apache.org/docs/latest/sql-data-sources-csv.html