- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-12-2024 05:43 AM
Data Loads are broadly classified into two types:
1. Batch load: When the source data is received on schedule, the data load is called as batch load. This is because we have a defined number of rows/ volume of data that needs to be processed at a time.
2. Streaming load: When the source data is received continuously, the data load is called as Streaming load. In this case, there is no fix volume of data that needs to be processed at a time. The data needs to be processed as soon as it is received.
As the two type of loads are quite different, the architectural requirement for the two is also different. A streaming table is just a Delta table that has extra support for a Streaming data load.