topic Copying/cloning Vector index table in Generative AI

Copying/cloning Vector index table

VELU1122 — Mon, 26 Aug 2024 00:05:24 GMT

Regarding copying or cloning vector index tables, it appears that direct copying or cloning is not possible, as Databricks throws the message: "Securable with kind TABLE_ONLINE_VECTOR_INDEX_REPLICA does not support Lakehouse Federation."

It seems that vector index tables cannot be copied or cloned directly and must be recreated or synchronized from a Delta table. Does anyone have more information on whether it is possible to directly copy or clone vector index tables?

Re: Copying/cloning Vector index table

Ismael-K — Wed, 05 Mar 2025 21:02:43 GMT

Direct cloning of a vector index table may not be possible. However, if Databricks generates the embeddings, you can enable "Sync computed embeddings" to save them to a Unity Catalog table. Alternatively, you can set the parameter sync_computed_embeddings=True when creating the vector index using the Python SDK for Vector Search to store the generated embeddings in a writeback table, which can then be cloned.