Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yesterday
Hi @RevanthV ,
We currently don't have such an option, and I think the only way is to use a filter to filter out the unwanted data. However, if you dont know about the source data and are performing a continuous append or have some backfill jobs that could accidentally write incorrect data, then we dont have any such option.
There is a bug already raised for the same issue in OSS: https://github.com/delta-io/delta/issues/5764,
I have a proposal and will try working on this and get back soon.
Anudeep
Feature request Which Delta project/connector is this regarding? Spark Standalone Flink Kernel Other (fill in here) Overview Feature request to add the same validation behavior from replaceWhere + "mode(overwrite)" to other write modes (...