Identity column for streaming target tables using declarative pipeline

Andolina
New Contributor III

Hi All,

I have few bronze streaming tables from which I want to load into silver target tables based on some joins. I am doing this by creating a streaming table and using a view to retrieve fields from each bronze table. After that I am using AUTO-CDC to perform CDC logic. I need to populate Identity columns in our silver tables which will be our surrogate keys for gold layer.

Its mentioned in the document that identity columns cannot be used with AUTO-CDC target:https://learn.microsoft.com/en-us/azure/databricks/ldp/limitations

Is there any way to populate Identity column for such target table? Any guidance would be appreciated!

Thanks,

Andolina