Hi @brockb ,

Thank you for your reply.

sure, I will elaborate more. so assume we have 3 files ( file1, file2 and file3). file 3 is locked by the system while it's adding data. dlt pipeline throws and error because it can't read file3 ( because it is locked by the system) " at least this is what we can tell for now). so I want to be able to exclude file3 or find an alternative way to have dlt pipeline doesn't crash and try to read the file later when it's unlocked by the system. When I exclude that file (file3) or wait till it's done (unlocked) the pipeline runs fine. We know it's done when we see a new file, like in this case when we see file4 then file3 is completed.
Here's the error if you are curious.