cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Feature Store - Feature Lookup with Filter

mayank347
New Contributor II

I am working with feature store to save the engineered features. However, for the specific case we have lots of feature table and lot of separate target variables on which we want to train separate models.

Now for each of these model, we can leverage the feature store table but we need to filter out the records based on some condition before joining these feature table to form the final training set. I am wondering if there is a way to include filters while making a feature lookup.

Please find an example below-

Lets say we have some customer data and have saved features into customer demographic, customer education, customer xyz and so on. Now we want to train separate model for different target variable which all can use these engineered features. However, for training model to predict target variable y1 - we need customer demographic data only from states A, B, and C, and join the corresponding features from other feature store tables.

So while performing FeatureLookup can we pass some filter to extract only customer from states A,B, and C

1 REPLY 1

Anonymous
Not applicable

Thanks for taking the time to let us know how to make Databricks even better! @Mayank Srivastava​  I love that you included a real-life example as well. 😊

I think I know the right PM at Databricks that will be interested in this input. Thanks again for sharing!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group