Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-08-2024 11:17 PM
Hey @szymon_dybczak ,
I checked my Storage Container and I am not getting any folder with the given checkpoint path. Do I need to setup anything differently for that? The concern which I am having is that the Incremental load was working well when using the directory listing mode but when changed to File notification mode it stopped picking up new files.
We are also not using rocksDB state store. We are using files store in ADLS Gen2 Storage container as an input and then dumping them in Streaming Delta Live Tables in Unity Catalog.
Thanks and Regards,
Ibrahim