Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
4 weeks ago
Got it! So those three bugs were the culprits:
Typo — inferSchemaccc instead of inferSchema
You stored the path in data but forgot to pass it into .load(data)
res.sh is incomplete — should be res.show()
from pyspark.sql.functions import *
data = "workspace.default.asl.csv"
df = (spark.read
.format("csv")
.option("header", "true")
.option("inferSchema", "true")
.option("delimiter", ",")
.load(data))
res = df
res.show()