cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is there a way to add Features descriptions for each of the features in a Feature Store table?

Yashir
New Contributor III

 If not, then I believe that it will be beneficial because the feature tables contain engineered features that its a good idea to document their calc logic for the benefit of other data scientists. Also, even non-engineered features are many times not clear by their name only.

5 REPLIES 5

Wunlung
Contributor

Yes, you can do it via

  1. the UI
    1. Go to the Feature Store
    2. Select the Feature Table
    3. Select individual feature
    4. You can edit the description there
    5. [OPTIONAL] You can also add the tags

I don't think there's a featurestoreClient API to update feature description, it does provide the capability to update the feature table description. Correct me if i am wrong.

API reference:

https://docs.databricks.com/dev-tools/api/python/latest/feature-store/client.html

Yashir
New Contributor III

Thanks for your detailed answer. Unfortunately i see no way of adding the "description" column to the Feature table's Features view. You would have to select each and every individual feature in order to view all descriptions. Also it would be beneficial to be able to assign a feature type (e.g. categorical, continuous, distinct, ordinal) and to have an API that fetches this info for EDA and DATA engineering processing.

They have the unoffical restAPI to update/retrieve it.

So official answer is no. They may plan to provide these functionalities in the future release.

ShaneVanHeerden
New Contributor II

Hi there

Has there perhaps been an update on this functionality? I am also attempting to programmatically update an individual feature's description and tag(s).

deep_thought
New Contributor III

I also would like to see support added for feature description get/set methods.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!