Thanks for checking, @Jeff_Zhang ! Just want to clarify regarding refreshing the state: you will need to toggle off & save, then toggle on again & save. Otherwise, format assistance/entity matching won't refresh. You will see a spinning wheel in the ...
@mmoise Multi Agent Supervisor (MAS) is an orchestrator agent, so it depends on: 1) how many agents it orchestrates, 2) how complex those agents are, and 3) how complex the user prompt is.
I would encourage you to review the MLflow experiment traces...
@mmoise
In the UI, when you create a Databricks App, you can select an existing chat template (see below), which will ask you for your model serving endpoint. In this context, you would provide the Multi Agent Supervisor's endpoint, which will be co...
Genie falls under Partner-powered AI features, so there was a change recently to align model hosting with Azure Geographies: Partner-powered AI features are now supported in the Canada, Brazil, and United Kingdom Azure Geographies
When you are using ai_query(), there are two main aspects to performance:
Model serving endpointSQL warehouse / Compute cluster
Very likely, the performance is throttled by the model-serving endpoint's concurrency limit. Reference: https://docs.d...
