Streaming Data Modeling Normalization with Databricks Delta Live Tables

Hubert-Dudek
Databricks MVP

Streamline Data Modeling Normalization with Databricks Delta Live Tables in Just a Few Steps:

- Use the "Apply changes" function to populate tables with slowly changing dimensions using auto-increment IDs.

- Register SQL mapping functions to associate dimension names with their respective IDs.

- In a subsequent stream, activate a function to replace values with the generated IDs in the SCD table.

scd1.png

 

 

 

 

 

scd2.png

 

 

 

scd3.png


My blog: https://databrickster.medium.com/