I have been able to successfully implement a Databricks vector search index with metadata filtering (How to create and query a vector search index | Databricks on AWS).

However, I am facing a challenge when implementing a more advanced filtering mechanism.

In my setup, I have a metadata column in the index that contains an array of strings. I need to create a filter that identifies matches based on the intersection between an input array and the index array. Specifically, a match should occur if the intersection returns at least one common value.

I don't see a straightforward way to do this with the existing Databricks vector search filter options.

Thanks for any advice!