I am trying to write data into a volume using below table.coalesce(1) .write .mode("overwrite") .format(file_format) .option("header", "true") .option("delimiter", field_delimiter) .option("compre...
Your understanding of my problem is correct.I did try adding this option, still not working..option("maxRecordsPerFile", 0) If I have to elaborate more I am trying to export the table to a volume as a single file with compression as gzip, but when gz...
