How to do a Full Load using DLT pipeline
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-12-2025 12:38 PM
if I use "spark.readStream" it does incremental loads and If I do "spark.read" it creates a materialised view.
What I want is: do a full load each time(no need of scd types) and it should be a streaming table and not a materialised view.
Any help would be appreciable.