topic Re: How can I use the feature store for time series out of sample prediction? in Machine Learning

How can I use the feature store for time series out of sample prediction?

NAS — Mon, 25 Oct 2021 06:08:34 GMT

For instance, have a new model trained every Saturday with training data up to the previous Fri, and use such model to predict daily the following week?

In the same context, if the features are keyed by date, could I create a training set with a different frequency (e.g. monthly)? Or I would have to recreate new features in monthly frequency?

Re: How can I use the feature store for time series out of sample prediction?

Dan_Z — Tue, 26 Oct 2021 19:14:56 GMT

I'm guessing you are using some sort of time-series model here, that uses some sort of auto-correlation? Usually for that you need to work with a complete time series. Are you doing one prediction for the entire week (by day)? Or are you doing a separate predictions every day? What `feature` do you want to store in the Feature Store to help achieve this?

Re: How can I use the feature store for time series out of sample prediction?

NAS — Tue, 26 Oct 2021 20:28:03 GMT

Hi Dan. I'm not using a times series model in this particular case. Just a classification model that takes the latest observation of a number of time series, and a few historical observations for some of them. I do daily predictions, but recalibrate the model every week.

Re: How can I use the feature store for time series out of sample prediction?

Dan_Z — Wed, 27 Oct 2021 03:35:04 GMT

@Nestor Sulikowski I'm honestly having a little trouble trying to grasp what you are trying to achieve. Surely, if you have some function that you use to cull the historical data or other time series features you can save those and the resultant data in the Feature Store. I don't see why you would have any issues with out of sample prediction if you are not using a time-series model.

Re: How can I use the feature store for time series out of sample prediction?

NAS — Wed, 27 Oct 2021 12:15:20 GMT

Thanks. I should write a more detailed question, but I'm lazy 🙂

Thanks for taking the time to share your thoughts.

Re: How can I use the feature store for time series out of sample prediction?

sean_owen — Fri, 17 Dec 2021 02:46:27 GMT

In this case, you just want your feature store to have a timestamp column as a timestamp key. You would compute your features as of whatever dates you like and add them as features, and those are used to train. At runtime, to make a prediction as of "now", you pass the current time as the value of the timestamp key. Under the hood it's an as-of join, which matches the latest time <= your value when finding the matching row.

Re: How can I use the feature store for time series out of sample prediction?

RasmusBrostroem — Wed, 11 Jun 2025 20:01:50 GMT

Hello, I just came across this and I have a similar question. I am quite new to Databricks and the feature store, but I wanted to use it, however, I am having some difficulty figuring out what specifically I can do.

In my case I am using XGBoost regression to do forecast for the next 48 hours, but I am using lagged value and rollback averages of the target variable that span from 1 hour to 48 hours back in the timeseries. Thus, I need to recalculate these lag and rollback variables as the model is making its forecast where I treat the forecasted value at t+1 as the true target when creating the forecasted value for t+2 and so on. Therefore I can't just have the true target lag and rollback variables be in the feature store, or can I? Is there something else I would have to do to be able to use the feature store setup in this situation?

Hope it makes sense, I appreciate all inputs and help 🙂