Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-17-2024 12:37 AM
the head function only returns a part of the file, that is what it does. The maxbytes you can pass has an upper limit of 64K (head(file: java.lang.String, maxBytes: int = 65536): java.lang.String).
You can read the file using spark (spark.read.csv) or plain python(using pandas or with open <file>), scala (using scala.io.Source