topic Re: Serverless Inference Setup Error in Machine Learning

Serverless Inference Setup Error

RJ — Tue, 07 Mar 2023 16:13:12 GMT

Hello,

I am using Azure Databricks Premium and am an Admin on the Workspace. I am trying to create a Serving Endpoint for a registered model created with MLFlow. I can make a traditional endpoint without issues, but when I try to make a serverless endpoint, I get the following error: "Model serving is not enabled for your workspacee. Please contact your organization admin or Databricks support."

I cannot find a setting anywhere to "enable" this. Please help!

Ryan

Re: Serverless Inference Setup Error

RJ — Thu, 09 Mar 2023 14:27:41 GMT

Thank you very much for the response; it works now!
Ryan

Re: Serverless Inference Setup Error

Debayan — Thu, 09 Mar 2023 06:17:49 GMT

Hi, Model serving was available generally from March 7th 2023 in Azure Databricks. (https://azure.microsoft.com/en-us/updates/generally-available-serverless-realtime-inference-for-azure-databricks/)

Also, there are region availabilities for the endpoints, could you please check if your region is under the listed regions here:

https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/#--region-availability

Please let us know if this helps.

Also please tag @Debayan with your next response which will notify me, Thank you!