Hi,

I have a question about DLT table.

Assume that I have a streaming DLT pipeline which reads data from a Bronze table and apply transformation on data.

Pipeline mode is triggered.

If I re-run the pipeline, does it append new data to the current table? If so, how to be sure that there is no duplicate in the resulting table?

In case of using structured streaming, method "writeStream" has an option "outputMode" to control how to write data. But, DLT pipeline doesn't have "writeStream" method. So, how can I control writing data into the DLT table?