Hi all,

Currently I have a standard notebook that it takes 2 dates as parameters, start date and end date it goes to the source then it pull only that portion of data then on target table deletes if necessary (if data within those ranges exists) the using the same date ranges as parameters inserts the data.

Now as you may notice this process we also use it when we need to reprocess back dated data, por example I get a notification that maybe that data of 2 weeks ago got a correction at the source so I run same process and it will only update that portion of the start date and end date I give.

I'm trying to transition using streaming tables and DLT Pipelines, is this possible to do with this functionality? Meaning can I re-process a streaming table only for an specific portion of the data?

Thanks in advance.