Best practice of handling Data Duplication in a Delta Live Table Pipeline with daily batch data source.
I am building a data pipeline using Delta Live table in Azure Databricks to move data from a raw data table to a feature table and model inference results table. However, I am concerned about the potential for duplication issues in future operations,...
- 3981 Views
- 1 replies
- 3 kudos
Latest Reply
Hi @Chengcheng Guo​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 3 kudos