Agent Serving Not Able To Use Route Optimisation
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-22-2025 01:05 PM
Hey y'all !
I have model that I already serve with `agents.deploy` and works fine.
I wanted to try out the Route Optimisation features as it can be found in the Edit tab of a model serving by adding in the creation via the API call (https://docs.databricks.com/api/workspace/servingendpoints/create). But I get the error which tells me to use `agents.deploy` but there are no parameters to deploy with the Route Optimisation turned on. (https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/route-optimization...)
I cannot add it in the Edit tab because when a model is already served, you cannot modify this feature.
Thanks in advance !
- Labels:
-
GenAIGeneration AI
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-30-2025 06:48 AM
Brahaman -
Thanks for reaching out. I hope I am interpreting the question correctly, but route optimization on Databricks serving endpoints can only be enabled at the time of endpoint creation. Update-in-place is not supported, and there is no way to enable route optimization for existing endpoints. You must create a new endpoint and explicitly enable route_optimized: true.
Let me know if that helps -
Sarah
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-20-2025 10:40 AM
@brahaman If this has solved your issue, please click the Accept as Solution button. Thanks!