Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-28-2022 07:06 AM
Not exactly. Lambda basically is streaming + batch simultaneously.
You can achieve that with databricks.
ingest real time data into your blob storage, and run reports on that data.
Also transform the data into f.e. golden layer in batch and also report on that.
But you don't need separate storage for the realtime (or near realtime) and batch.
Having separate clusters for SQL workloads and ETL/ELT is a good idea, although technically not necessary. But I would do it.