Select LLM in Agentbricks - Knowledge Assistant

[Yash01Kumar12]

Hello,

I am preparing a demo using for Multi Agent Supervisor Agent using knowledge assistant and Genie. Throughout the demo creation I have the following doubts:

1) In the Knowledge assistant can we select another LLM model. Also, by default which LLM is used, is it DBRX?
2) If we can select the LLM of our choice, then from UI where we can select the model, there is no option to select which make me to conclude that we can't select.
3) I was looking into the Databricks agents SDK, it has the option to create the LLM of own choice, is it the only way to create agents with custom models.

4) Regarding Genie, is there any specific pricing calculator for Genie.

That's a lot, but if you can help to answer these, this will help me a lot.

Thank you

[saurabh18cs]

Hi @Yash01Kumar12 

1) I think you're correct = Knowledge Assistant in Databricks does not allow you to select a different LLM from the UI

4) There is no dedicated pricing calculator for Genie as of now. Genie’s usage is typically billed as part of Databricks’ serverless or workspace compute, and LLM usage may incur additional costs.

Databricks Pricing: Flexible Plans for Data and AI Solutions | Databricks

[Yash01Kumar12]

Thank you @saurabh18cs 

[saurabh18cs]

your welcome

[Louis_Frolio]

@Yash01Kumar12 , there is no KA UI option to select the LLM. You configure knowledge sources and instructions; model choice is handled automatically by Agent Bricks.

Hope this helps, Louis.

[Louis_Frolio]

A bit more information:

In Agent Bricks, Databricks “automatically try various AI models, fine‑tune them using your data, optimize, and evaluate” to pick the best system for your use case — model selection is managed by the backend rather than the KA UI.