Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-23-2025 12:00 AM
Hi @shan-databricks , Try with below option
df = ( spark.readStream .format("cloudFiles")
.option("cloudFiles.format", "csv")
.option("badRecordsPath", "/mnt/my-bad-records")
#.option("mode", "PERMISSIVE") # Do NOT set this!
.schema(my_schema) .load("/mnt/data") )