cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Streaming Data Modeling Normalization with Databricks Delta Live Tables

Hubert-Dudek
Esteemed Contributor III

Streamline Data Modeling Normalization with Databricks Delta Live Tables in Just a Few Steps:

- Use the "Apply changes" function to populate tables with slowly changing dimensions using auto-increment IDs.

- Register SQL mapping functions to associate dimension names with their respective IDs.

- In a subsequent stream, activate a function to replace values with the generated IDs in the SCD table.

scd1.png

 

 

 

 

 

scd2.png

 

 

 

scd3.png

1 REPLY 1

jose_gonzalez
Moderator
Moderator

Thank you for sharing this @Hubert-Dudek !!!

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.