topic Re: ML Model serving cluster tags? in Machine Learning

ML Model serving cluster tags?

Deep — Sun, 29 May 2022 15:47:47 GMT

Is there a way to add tags automatically to ML Model serving clusters? I see we can add tags to the model itself which persist but any tags I add to the cluster serving it do not after the endpoint is stopped.

This would be important to track billing in AWS as the clusters are what we need tags on. It is very tedious and impractical to add any number of tags every time we enable serving on a model.

Re: ML Model serving cluster tags?

Deep — Mon, 30 May 2022 12:58:40 GMT

Is there a way to propagate these tags from the Details tab? The Serving tab resets every time the model is stopped and the tags must be reapplied every time.

Re: ML Model serving cluster tags?

Prabakar — Tue, 31 May 2022 13:02:33 GMT

@Deep Kalra The cluster tags should help you.

https://docs.databricks.com/applications/mlflow/model-serving.html#customize-the-serving-cluster

Re: ML Model serving cluster tags?

Anonymous — Thu, 28 Jul 2022 17:20:34 GMT

Hey there @Deep Kalra

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!