Hi all,

When I design a streaming data pipeline with incoming moving files and used apply chnge function on silver table comparing change between bronze and silver for removing duplicates based on key columns, do you know why I got ignore change to true error?

The flow is like this:

Files - Stream table bronze raw - temp bronze - apply change function to create bronze table - temp table - silver table.

The error happend on the apply change function when more files are moving into the folder.

The only solution is to refresh all. If you do refresh but not all, It will pop up ignore changes... change a different directory.

Thank