Save VM cost when using Rest API deploying models for online inference

[jhonw901227]

ADB allows us to deploy the models for online inference through a REST API. To that aim ADB creates a VM dedicated to serve a specific model. Data Scientist can create and deploy several models for testing online inference, thus the cost can rapidly grow uncontroled and unnecessarily because those newly created VMs are running all the time.

It is possible to shut them down after certain period of inactivity?

[Hernandez855]

@John Wilmar Herrera Gil​ , See https://community.databricks.com/s/question/0D58Y00008oTDBFSA4/expose-low-latency-apis-from-deltalak...H&R Block Login

[Anonymous]

Hey there @John Wilmar Herrera Gil​ 

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

[jhonw901227]

Thanks you can close this, the solution is wait until new databricks version is delivered.

The new version has new features for model serving using AKS in the background.

Thanks

[Anonymous]

Hey @John Wilmar Herrera Gil​ 

Thank you so much for getting back to us.

We really appreciate your time.

Wish you a great Databricks journey ahead!