databricks-vectorsearch lib install

[ccataV]

Hello,

I'm trying to create and query a vector searc index like in this example : How to create and query a Vector Search index | Databricks on AWS on a databricks on azure. I have a cluster ina  private network so i need to install the suggested lib : databricks-vectorsearch · PyPI manually . 

So i tried to find the right version for my cluster that is : 15.0 ML (includes Apache Spark 3.5.0, Scala 2.12) with Python version 3.10 but i dont manage , all are failing at installation . How i can find the right lib version to install it ?

Anyone had the same experience or faced something similar?

Any suggestion or help will be much appreciate.

Thank you. 

[Kumaran]

Hi @ccataV 

Thank you for contacting Databricks community support!

Can you try to use 14.3 ML DBR and see how it works?

[shan_chandra]

@ccataV - Databricks vector search is in public preview in selected regions as per the below documentation. However, since you look like a PVC user, you may need to reach out to Databricks support for accessibility.

https://docs.databricks.com/en/generative-ai/vector-search.html#limitations