cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

dfighter1312
by New Contributor
  • 4712 Views
  • 3 replies
  • 1 kudos

Behavior of Vector Index Sync with Delta Tables When Using OVERWRITE vs MERGE in Databricks

I'm working with vector search in Databricks using vector index sync with Delta tables, and I'm a bit unclear on how updates to the source table affect the vector index, specifically when using different write operations.If I overwrite the source Del...

  • 4712 Views
  • 3 replies
  • 1 kudos
Latest Reply
jameswood32
Contributor
  • 1 kudos

From community experience, vector index sync behavior depends heavily on how the Delta table is updated. With OVERWRITE, the table is effectively replaced, so the vector index typically treats this as a full refresh. Existing embeddings are dropped a...

  • 1 kudos
2 More Replies