Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
To save computing resource and time, can I use streaming source in a batch mode (similar to Auto Loader) to update my feature store as my source table receives row update or is appended with new rows?
Yes you can. Use Streaming doesn't mean having a cluster running all the time. You can schedule your job to run on the top of every hour or everyday to process the data with Autoloader.