topic Re: Agent Serving Not Able To Use Route Optimisation in Generative AI

Agent Serving Not Able To Use Route Optimisation

brahaman — Mon, 22 Sep 2025 20:05:36 GMT

Hey y'all !

I have model that I already serve with `agents.deploy` and works fine.
I wanted to try out the Route Optimisation features as it can be found in the Edit tab of a model serving by adding in the creation via the API call (https://docs.databricks.com/api/workspace/servingendpoints/create). But I get the error which tells me to use `agents.deploy` but there are no parameters to deploy with the Route Optimisation turned on. (https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/route-optimization#limitations)

I cannot add it in the Edit tab because when a model is already served, you cannot modify this feature.

Thanks in advance !

Re: Agent Serving Not Able To Use Route Optimisation

sarahbhord — Tue, 30 Sep 2025 13:48:27 GMT

Brahaman -

Thanks for reaching out. I hope I am interpreting the question correctly, but route optimization on Databricks serving endpoints can only be enabled at the time of endpoint creation. Update-in-place is not supported, and there is no way to enable route optimization for existing endpoints. You must create a new endpoint and explicitly enable route_optimized: true.

Let me know if that helps -

Sarah

Re: Agent Serving Not Able To Use Route Optimisation

MandyR — Mon, 20 Oct 2025 17:40:52 GMT

@brahaman If this has solved your issue, please click the Accept as Solution button. Thanks!