https://community.databricks.com/t5/data-engineering/streaming-data-modeling-normalization-with-databricks-delta-live/m-p/46635#M28077 <P>Thank you for sharing this&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/25346">@Hubert-Dudek</a>&nbsp;!!!</P> Thu, 28 Sep 2023 16:41:42 GMT jose_gonzalez 2023-09-28T16:41:42Z https://community.databricks.com/t5/data-engineering/streaming-data-modeling-normalization-with-databricks-delta-live/m-p/46320#M28044 <P>Streamline Data Modeling Normalization with Databricks Delta Live Tables in Just a Few Steps:</P><P>- Use the "Apply changes" function to populate tables with slowly changing dimensions using auto-increment IDs.</P><P>- Register SQL mapping functions to associate dimension names with their respective IDs.</P><P>- In a subsequent stream, activate a function to replace values with the generated IDs in the SCD table.</P><P><span class="lia-inline-image-display-wrapper lia-image-align-left" image-alt="scd1.png" style="width: 999px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/4045i63EFA1688ED07CDD/image-size/large/is-moderation-mode/true?v=v2&amp;px=999" role="button" title="scd1.png" alt="scd1.png" /></span></P><P>&nbsp;</P><P>&nbsp;</P><P>&nbsp;</P><P>&nbsp;</P><P>&nbsp;</P><P><span class="lia-inline-image-display-wrapper lia-image-align-left" image-alt="scd2.png" style="width: 999px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/4046i6792ACD79E21304E/image-size/large/is-moderation-mode/true?v=v2&amp;px=999" role="button" title="scd2.png" alt="scd2.png" /></span></P><P>&nbsp;</P><P>&nbsp;</P><P>&nbsp;</P><P><span class="lia-inline-image-display-wrapper lia-image-align-left" image-alt="scd3.png" style="width: 999px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/4047i5C362932A5FAC5C2/image-size/large/is-moderation-mode/true?v=v2&amp;px=999" role="button" title="scd3.png" alt="scd3.png" /></span></P> Tue, 26 Sep 2023 20:09:46 GMT https://community.databricks.com/t5/data-engineering/streaming-data-modeling-normalization-with-databricks-delta-live/m-p/46320#M28044 Hubert-Dudek 2023-09-26T20:09:46Z https://community.databricks.com/t5/data-engineering/streaming-data-modeling-normalization-with-databricks-delta-live/m-p/46635#M28077 <P>Thank you for sharing this&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/25346">@Hubert-Dudek</a>&nbsp;!!!</P> Thu, 28 Sep 2023 16:41:42 GMT https://community.databricks.com/t5/data-engineering/streaming-data-modeling-normalization-with-databricks-delta-live/m-p/46635#M28077 jose_gonzalez 2023-09-28T16:41:42Z