cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Save VM cost when using Rest API deploying models for online inference

jhonw901227
New Contributor II

ADB allows us to deploy the models for online inference through a REST API. To that aim ADB creates a VM dedicated to serve a specific model. Data Scientist can create and deploy several models for testing online inference, thus the cost can rapidly grow uncontroled and unnecessarily because those newly created VMs are running all the time.

It is possible to shut them down after certain period of inactivity?

4 REPLIES 4

Anonymous
Not applicable

Hey there @John Wilmar Herrera Gil​ 

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Thanks you can close this, the solution is wait until new databricks version is delivered.

The new version has new features for model serving using AKS in the background.

Thanks

Anonymous
Not applicable

Hey @John Wilmar Herrera Gil​ 

Thank you so much for getting back to us.

We really appreciate your time.

Wish you a great Databricks journey ahead!

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.