Setting Column Only on Insert with DLT's apply_changes CDC Merge

Ru — Tue, 20 Feb 2024 15:04:33 GMT

Hi Databricks Community,

We've encountered an issue with setting a column only on insert when using DLT's apply_changes CDC merge functionality. It's important to note that this capability is available when using the regular Delta merge operation, specifically through whenNotMatchedInsert option.

If we want to setup a `CreatedDate` on initial insert. Is there any option available to solve this when using apply_changes, similar to how it's achievable with the regular Delta merge operation (https://docs.databricks.com/en/delta/merge.html)?

topic Setting Column Only on Insert with DLT's apply_changes CDC Merge in Data Engineering

Setting Column Only on Insert with DLT's apply_changes CDC Merge