Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-21-2024 05:58 AM
Hi @Sambit_S,
File notification would only impact any new arriving files, so unless you have a backfill interval to load any existing data it will not load existing data. You could also backfill initially by using directory mode and then switch to file notification for new arriving data. This can be done with the same checkpoint.
From the logs you shared it shows that there are no outstanding bytes or files, so this could indicate that the existing data is not being loaded.
Let me know if it helps.