Agent Serving Not Able To Use Route Optimisation
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-22-2025 01:05 PM
Hey y'all !
I have model that I already serve with `agents.deploy` and works fine.
I wanted to try out the Route Optimisation features as it can be found in the Edit tab of a model serving by adding in the creation via the API call (https://docs.databricks.com/api/workspace/servingendpoints/create). But I get the error which tells me to use `agents.deploy` but there are no parameters to deploy with the Route Optimisation turned on. (https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/route-optimization...)
I cannot add it in the Edit tab because when a model is already served, you cannot modify this feature.
Thanks in advance !
Labels:
- Labels:
-
GenAIGeneration AI