https://community.databricks.com/t5/data-engineering/dlt-bronze-incremental-file-updates/m-p/57818#M30924 <P>You can use the option "<SPAN>cloudFiles.allowOverwrites</SPAN>" in DLT. This option will allow you to read the same csv file again but you should use it cautiously, as it can lead to duplicate data being loaded.</P> Thu, 18 Jan 2024 19:08:36 GMT Lakshay 2024-01-18T19:08:36Z https://community.databricks.com/t5/data-engineering/dlt-bronze-incremental-file-updates/m-p/57793#M30916 <P>Hi there, I would like to clarify if there's a way for bronze data to be ingested from "the same" CSV file if the file has been modified (i.e. new file with new records overwriting the old file)? Currently in my setup my bronze table is a `streaming table` and it successfully adds incremental data only as new files arrive, but if a file is overwritten with new data that file is ignored going forward.</P><P>Does DLT offer the capability to reprocess modified files?</P> Thu, 18 Jan 2024 16:35:56 GMT https://community.databricks.com/t5/data-engineering/dlt-bronze-incremental-file-updates/m-p/57793#M30916 ChristianRRL 2024-01-18T16:35:56Z https://community.databricks.com/t5/data-engineering/dlt-bronze-incremental-file-updates/m-p/57818#M30924 <P>You can use the option "<SPAN>cloudFiles.allowOverwrites</SPAN>" in DLT. This option will allow you to read the same csv file again but you should use it cautiously, as it can lead to duplicate data being loaded.</P> Thu, 18 Jan 2024 19:08:36 GMT https://community.databricks.com/t5/data-engineering/dlt-bronze-incremental-file-updates/m-p/57818#M30924 Lakshay 2024-01-18T19:08:36Z