K_Anudeep
Databricks Employee
Databricks Employee

Hi @RevanthV ,

We currently don't have such an option, and I think the only way is to use a filter to filter out the unwanted data. However, if you dont know about the source data and are performing a continuous append or have some backfill jobs that could accidentally write incorrect data, then we dont have any such option.

There is a bug already raised for the same issue in OSS: https://github.com/delta-io/delta/issues/5764,

I have a proposal and will try working on this and get back soon.

Anudeep