topic Re: Assistance with Combined Filters in Databricks Vector Store Index in Generative AI

Assistance with Combined Filters in Databricks Vector Store Index

kanks987 — Thu, 17 Oct 2024 07:40:00 GMT

Hi,

I’m working with the Databricks vector store index and need to apply combined filters to retrieve chunks that meet specific criteria.

My index contains the following columns: product_category, product_date, and description.

Question 1: How can I retrieve all chunks that meet this filter criteria:

Product category is either:
- Category 1 with dates from 2015-2016, or
- All products from Category 2?

Question 2: How can I filter to get only those chunks where the description contains both term1 and term2?

I would appreciate a prompt response.

Thank you!

davidhuang — Thu, 24 Oct 2024 05:53:51 GMT

You can achieve that by using metadata filtering when querying the VS index. Check this section in our VS Index documentation: https://docs.databricks.com/en/generative-ai/create-query-vector-search.html#query-a-vector-search-endpoint

altaysaid — Thu, 12 Dec 2024 12:33:59 GMT

How do we do multiple filters? for example I want to filter a vector store by two columns with an AND logic.