I am trying to write data into a volume using below
table.coalesce(1)
.write
.mode("overwrite")
.format(file_format)
.option("header", "true")
.option("delimiter", field_delimiter)
.option("compression", "gzip")
.save(temp_path)
Command is running successfully but when I download the file I see for 1 file for each record of the table inside the zipped folder.
Command is running successfully but when I download the file I see for 1 file for each record of the table inside the zipped folder.
Note: Without compression, file is exported as expected.
