Parquet to csv delta file
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-26-2023 08:51 PM
Hi Team,
I have a parquet file in s3 bucket which is a delta file I am able to read it but I am unable to write it as a csv file.
getting the following error when i am trying to write:
A transaction log for Databricks Delta was found at `s3://path/abc/_delta_log`,
but you are trying to write to `s3://path/abc/` using format("csv"). You must use
'format("delta")' when reading and writing to a delta table.
I am using this method to write to csv
abc.write.format("delta").mode("overwrite").options(delimiter="|").csv(destinationBucketPath)
let me know if I need to change anything.
Labels:
- Labels:
-
CSV File
-
Databricks delta