File optimization for delta table (versioning and snapshot ) in storage S3
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-13-2023 11:14 PM
Delta table generates new file for every insert or update on table and keep the old version files also for versioning and time travel history .
I have 1tb data as delta table and every 30 minutes , 90 percent data getting updated so file size will be getting increase exponentially .
Is there any way to optimize the storage size ( want to keep 1 week time travel history also)