cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Agent Serving Not Able To Use Route Optimisation

brahaman
New Contributor II

Hey y'all !

I have model that I already serve with `agents.deploy` and works fine.
I wanted to try out the Route Optimisation features as it can be found in the Edit tab of a model serving by adding in the creation via the API call (https://docs.databricks.com/api/workspace/servingendpoints/create). But I get the error which tells me to use `agents.deploy` but there are no parameters to deploy with the Route Optimisation turned on. (https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/route-optimization...)

I cannot add it in the Edit tab because when a model is already served, you cannot modify this feature.

Thanks in advance !

0 REPLIES 0

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now