topic Vector search index stops at 45406 in Machine Learning

Vector search index stops at 45406

nikviz — Tue, 26 Nov 2024 11:22:08 GMT

I am trying to create a vector search index for a table, but it stops at 45406 rows. I can see that the writeback table has all the records but the indexing stops. Is there a hard limit on index?

Re: Vector search index stops at 45406

Walter_C — Tue, 26 Nov 2024 14:15:26 GMT

There are some limits that you can be hitting:

Row Size for Delta Sync Index: The maximum row size is 100KB.
Embedding Source Column Size for Delta Sync Index: The maximum size is 32764 bytes.
Bulk Upsert Request Size Limit for Direct Vector Index: The maximum size is 10MB.
Bulk Delete Request Size Limit for Direct Vector Index: This limit is not specified in the provided context.

Re: Vector search index stops at 45406

nikviz — Wed, 27 Nov 2024 11:32:37 GMT

Thank you so much. I reduced my chunk size and it worked.