- 4215 Views
- 1 replies
- 3 kudos
Best practice of handling Data Duplication in a Delta Live Table Pipeline with daily batch data source.
I am building a data pipeline using Delta Live table in Azure Databricks to move data from a raw data table to a feature table and model inference results table. However, I am concerned about the potential for duplication issues in future operations,...
- 4215 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
Hi @Chengcheng Guo​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 3 kudos
- 841 Views
- 1 replies
- 0 kudos
- 841 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
No, currently views are only available to other tables in the pipeline. However, tables are persisted outside of the pipeline.
- 0 kudos