cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Is there a way to add Features descriptions for each of the features in a Feature Store table?

Yashir
New Contributor III

 If not, then I believe that it will be beneficial because the feature tables contain engineered features that its a good idea to document their calc logic for the benefit of other data scientists. Also, even non-engineered features are many times not clear by their name only.

5 REPLIES 5

Wunlung
Contributor

Yes, you can do it via

  1. the UI
    1. Go to the Feature Store
    2. Select the Feature Table
    3. Select individual feature
    4. You can edit the description there
    5. [OPTIONAL] You can also add the tags

I don't think there's a featurestoreClient API to update feature description, it does provide the capability to update the feature table description. Correct me if i am wrong.

API reference:

https://docs.databricks.com/dev-tools/api/python/latest/feature-store/client.html

Yashir
New Contributor III

Thanks for your detailed answer. Unfortunately i see no way of adding the "description" column to the Feature table's Features view. You would have to select each and every individual feature in order to view all descriptions. Also it would be beneficial to be able to assign a feature type (e.g. categorical, continuous, distinct, ordinal) and to have an API that fetches this info for EDA and DATA engineering processing.

They have the unoffical restAPI to update/retrieve it.

So official answer is no. They may plan to provide these functionalities in the future release.

ShaneVanHeerden
New Contributor II

Hi there

Has there perhaps been an update on this functionality? I am also attempting to programmatically update an individual feature's description and tag(s).

deep_thought
Contributor

I also would like to see support added for feature description get/set methods.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group