- 3216 Views
- 2 replies
- 1 kudos
Model serving with GPU cluster
Hello Databricks community!We are facing a strong need of serving some of public and our private models on GPU clusters and we have several requirements:1) We'd like to be able to start/stop the endpoints (best with scheduling) to avoid excess consum...
- 3216 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Alisher Akh​ Does @Debayan Mukherjee​'s answer help? If yes, would you be happy to mark the answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you further. Cheers!
- 1 kudos
- 3282 Views
- 2 replies
- 2 kudos
Serverless Inference Setup Error
Hello, I am using Azure Databricks Premium and am an Admin on the Workspace. I am trying to create a Serving Endpoint for a registered model created with MLFlow. I can make a traditional endpoint without issues, but when I try to make a serverless en...
- 3282 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi, Model serving was available generally from March 7th 2023 in Azure Databricks. (https://azure.microsoft.com/en-us/updates/generally-available-serverless-realtime-inference-for-azure-databricks/) Also, there are region availabilities for the endpo...
- 2 kudos