Databricks Community

GarciaJorge

Hi everyone,I’m dealing with a scenario combining Delta Live Tables, CDC ingestion, and streaming pipelines, and I’ve hit a challenge that I haven’t seen clearly addressed in the docs.Some Context:Source is an upstream system emitting CDC events (ins...

GarciaJorge

Thanks, this is very helpful.The idea of introducing a normalization layer before merges is interesting. I had not considered that as a separate step.Have you seen any performance impact when adding this extra layer in DLT pipelines at scale?

Databricks Community

User Stats

User Activity

DLT with CDC and schema changes in streaming pipelines

Re: DLT with CDC and schema changes in streaming pipelines