Save VM cost when using Rest API deploying models for online inference

jhonw901227
Databricks Partner

‎06-09-2022 02:31 PM

ADB allows us to deploy the models for online inference through a REST API. To that aim ADB creates a VM dedicated to serve a specific model. Data Scientist can create and deploy several models for testing online inference, thus the cost can rapidly grow uncontroled and unnecessarily because those newly created VMs are running all the time.

It is possible to shut them down after certain period of inactivity?

0 Kudos

Anonymous
Not applicable

‎08-17-2022 10:30 AM

Hey there @John Wilmar Herrera Gil​ 

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

0 Kudos

jhonw901227
Databricks Partner
In response to Anonymous

‎08-17-2022 11:51 AM

Thanks you can close this, the solution is wait until new databricks version is delivered.

The new version has new features for model serving using AKS in the background.

Thanks

0 Kudos

Anonymous
Not applicable

‎08-18-2022 07:46 AM

Hey @John Wilmar Herrera Gil​ 

Thank you so much for getting back to us.

We really appreciate your time.

Wish you a great Databricks journey ahead!

0 Kudos