topic Re: databricks-vectorsearch lib install in Machine Learning

databricks-vectorsearch lib install

ccataV — Wed, 03 Apr 2024 14:33:12 GMT

Hello,

I'm trying to create and query a vector searc index like in this example : How to create and query a Vector Search index | Databricks on AWS on a databricks on azure. I have a cluster ina private network so i need to install the suggested lib : databricks-vectorsearch · PyPI manually .

So i tried to find the right version for my cluster that is : 15.0 ML (includes Apache Spark 3.5.0, Scala 2.12) with Python version 3.10 but i dont manage , all are failing at installation . How i can find the right lib version to install it ?

Anyone had the same experience or faced something similar?

Any suggestion or help will be much appreciate.

Thank you.

Re: databricks-vectorsearch lib install

Kumaran — Tue, 30 Apr 2024 18:52:52 GMT

Hi @ccataV

Thank you for contacting Databricks community support!

Can you try to use 14.3 ML DBR and see how it works?

Re: databricks-vectorsearch lib install

shan_chandra — Tue, 07 May 2024 16:47:37 GMT

@ccataV - Databricks vector search is in public preview in selected regions as per the below documentation. However, since you look like a PVC user, you may need to reach out to Databricks support for accessibility.

https://docs.databricks.com/en/generative-ai/vector-search.html#limitations