Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-04-2024 02:48 AM
Thank you @raphaelblg!
I chose to write an article on the subject after this discussion: https://www.linkedin.com/pulse/databricks-delta-live-tables-merging-lau-johansson-cdtce/?trackingId=...
Introduction When implementing with the medallion architecture in a Lakehouse setup, I often see this pattern: Bronze table: Raw data is continuously appended Silver table: SCD Type 1 processing, retaining only the latest data for each ID. Gold table: Aggregated business data.