Is it possible to write tables to delta lake using upsert mode? Would it be more efficiant than overwrite?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-07-2022 05:09 AM
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-07-2022 05:16 AM
@Direo Direo , Yes, you use Merge syntax for that https://docs.delta.io/latest/delta-update.html.
And is more efficient than overwriting if you want to update only part of the data, but you need to think about the logic of what to update so overwriting is easier to manage.