Does Delta Table can be the source of streaming/auto loader?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2024 03:25 AM
Hi,
Since the Auto Loader only accept "append-only" data as the source, I am wondering if the "Delta Table" can also be the source.
Does VACCUM(deleting stale files) or _delta_log(creating nested and different file format than parquet) going to break Auto Loader mechanism?