cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

lucami
by Contributor
  • 471 Views
  • 2 replies
  • 2 kudos

How to use CrewAI with Databricks-hosted LLMs (not OpenAI) ?

I am trying to use CrewAI to train an agent with a Databricks-hosted LLM (such as Llama 2 instruct or DBRX) via the databricks_langchain integration. I want CrewAI to use only my Databricks LLM and not requiring OpenAI authentication.However, when I ...

  • 471 Views
  • 2 replies
  • 2 kudos
Latest Reply
pavannaidu
Databricks Employee
  • 2 kudos

@lucami  To configure CrewAI to use only Databricks-hosted models without OpenAI dependencies Use CrewAI's LLM class (which wraps litellm) rather than ChatDatabricks Pass the LLM at both levels: agents use it to complete their tasks, and the crew u...

  • 2 kudos
1 More Replies