showing only a limited number of lines from the CSV file
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-24-2024 02:14 AM - last edited on 07-24-2024 03:48 AM by Retired_mod
Expected no of lines is - 16400
Showing only 20 No of records
Script
spark.conf.set(
"REDACTED",
"REDACTED"
)
# File location
file_location = "REDACTED"
# Read in the data to dataframe df
df = spark.read.format("CSV").option("inferSchema", "true").option("header", "true").option("delimiter", ",").load(file_location).show()
