topic Feature Store : for sklearn flavored models, are timestamps fully supported? in Machine Learning

Feature Store : for sklearn flavored models, are timestamps fully supported?

thib — Fri, 28 Jan 2022 13:57:25 GMT

I have created a feature table (Databricks runtime ML 10.2) that includes a timestamp column as a primary key, that is not used as a feature but as a column to join on.

I have then created a model that trains from this feature table and some additional data, which excludes the primary keys. I tried excluding them, both using the feature store api, and from the sklearn api. The model is being trained fine, but when use the score_batch() method, I get an error claiming that 'TypeError: float() argument must be a string or a number, not 'Timestamp''.

This error is coming from sklearn, so is there some incompatibility there, or is this a bug in feature store?

Steps to reproduce :

create feature table with one column as timestamp type
train a model using sklearn that does not use that timestamp column
use score_batch() method and visualize results

Re: Feature Store : for sklearn flavored models, are timestamps fully supported?

Hubert-Dudek — Fri, 28 Jan 2022 15:15:19 GMT

maybe you can just try to cast timestamp as int

Re: Feature Store : for sklearn flavored models, are timestamps fully supported?

thib — Sat, 29 Jan 2022 13:20:23 GMT

Thanks for your reply Hubert. Yes, casting it to long or int does solve the issue, but it is a workaround and I would like to keep the data as-is, with directly interpretable timestamps, especially when there is no reason why they should trigger an error during the prediction step since it is not being used at that stage.

Re: Feature Store : for sklearn flavored models, are timestamps fully supported?

jose_gonzalez — Tue, 15 Mar 2022 00:06:04 GMT

Hi @Thibault Daoulas ,

Did @Kaniz Fatma response help you to resolved your question? if yes, please mark it as best response. If not, please let us know.

Re: Feature Store : for sklearn flavored models, are timestamps fully supported?

thib — Tue, 15 Mar 2022 07:56:05 GMT

Hi, it did not, but at least I know they are not fully supported so a workaround is to avoid timestamps, so I suppose you can mark this as resolved