Exporting delta table to one CSV
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-01-2023 02:39 PM
Process to export a delta table is taking ~2hrs.
Delta table has 66 partitions with total size of ~6gb, 4million rows and 270 columns.
Used below command
df.coalesce(1).write.csv("path")what are my options to reduce the time?
