cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Chengcheng
by New Contributor III
  • 2661 Views
  • 1 replies
  • 3 kudos

Best practice of handling Data Duplication in a Delta Live Table Pipeline with daily batch data source.

I am building a data pipeline using Delta Live table in Azure Databricks to move data from a raw data table to a feature table and model inference results table. However, I am concerned about the potential for duplication issues in future operations,...

  • 2661 Views
  • 1 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Chengcheng Guo​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.

  • 3 kudos
Ryan_Chynoweth
by Honored Contributor III
  • 530 Views
  • 1 replies
  • 0 kudos
  • 530 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ryan_Chynoweth
Honored Contributor III
  • 0 kudos

No, currently views are only available to other tables in the pipeline. However, tables are persisted outside of the pipeline.

  • 0 kudos
Labels