cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Streaming Source for Feature Store (and outputMode)

lawrence009
Contributor

To save computing resource and time, can I use streaming source in a batch mode (similar to Auto Loader) to update my feature store as my source table receives row update or is appended with new rows?

2 REPLIES 2

youssefmrini
Honored Contributor III
Honored Contributor III

Yes you can. Use Streaming doesn't mean having a cluster running all the time. You can schedule your job to run on the top of every hour or everyday to process the data with Autoloader.

Meghala
Valued Contributor II

yes you can schedule the job to process the data with auto loader

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.