databricks-vectorsearch lib install

ccataV
New Contributor

‎04-03-2024 07:32 AM - edited ‎04-03-2024 07:33 AM

Hello,

I'm trying to create and query a vector searc index like in this example : How to create and query a Vector Search index | Databricks on AWS on a databricks on azure. I have a cluster ina  private network so i need to install the suggested lib : databricks-vectorsearch · PyPI manually . 

So i tried to find the right version for my cluster that is : 15.0 ML (includes Apache Spark 3.5.0, Scala 2.12) with Python version 3.10 but i dont manage , all are failing at installation . How i can find the right lib version to install it ?

Anyone had the same experience or faced something similar?

Any suggestion or help will be much appreciate.

Thank you. 

0 Kudos

Kumaran
Databricks Employee
Databricks Employee

‎04-30-2024 11:52 AM

Hi @ccataV 

Thank you for contacting Databricks community support!

Can you try to use 14.3 ML DBR and see how it works?

0 Kudos

shan_chandra
Databricks Employee
Databricks Employee

‎05-07-2024 09:47 AM

@ccataV - Databricks vector search is in public preview in selected regions as per the below documentation. However, since you look like a PVC user, you may need to reach out to Databricks support for accessibility.

https://docs.databricks.com/en/generative-ai/vector-search.html#limitations

0 Kudos