cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Entity Matching on struct column

Malthe
Valued Contributor

Databricks Genie allows configurable prompt matching, for example entity matching:

Entity matching provides curated lists of distinct values for up to 120 columns where users are likely to reference specific entries, such as states and product categories. This helps Genie match user terminology to actual data values.

What if we're using a column that's a struct composed of a categorical event value and a timestamp–? This is common in status tables where we've got the latest event along with when that event occurred.

It would be ideal if entity matching would look into such structs and treat each field separately. Does that already happen?

1 ACCEPTED SOLUTION

Accepted Solutions

aleksandra_ch
Databricks Employee
Databricks Employee

Hi @Malthe ,

Entity matching supports simple data types only (no structs). The recommended approach is to flatten the table structure before passing it to Genie. 

Hope it helps,.

Best regards,

View solution in original post

1 REPLY 1

aleksandra_ch
Databricks Employee
Databricks Employee

Hi @Malthe ,

Entity matching supports simple data types only (no structs). The recommended approach is to flatten the table structure before passing it to Genie. 

Hope it helps,.

Best regards,