cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

wind2025
by New Contributor II
  • 116 Views
  • 1 replies
  • 1 kudos

I am struggling on complicated RAG code for Mosaic evaluation deployment

I want to know how I can apply some complicated RAG designs so I can directly deploy on the Mosaic AI evaluation UI. There are two cases:1. two or more index retrieval as independent tools (parallel retrievals)2.two index retrieval processes that dep...

  • 116 Views
  • 1 replies
  • 1 kudos
Latest Reply
Mantsama4
Contributor III
  • 1 kudos

Interesting use case, would love to know the answer!

  • 1 kudos
paalvibe
by New Contributor III
  • 196 Views
  • 2 replies
  • 0 kudos

Should elaborate and complex LLM apps be deployed as MLFlow serving endpoints?

In a project we are building increasingly complex LLM-based Apps (RAG, multi-agent workflows, langgraph, unstructured ingestion etc), and we are having doubts if these apps should be deployed as MLFlow-based endpoints. I would like your feedback on i...

  • 196 Views
  • 2 replies
  • 0 kudos
Latest Reply
paalvibe
New Contributor III
  • 0 kudos

Actually, maybe root folder was imprecise. The point is that it gets file system access. It becomes a regular Workspace user, with too much access. If, however, you want to give it specific accesses beyond that, you could give it access to specific v...

  • 0 kudos
1 More Replies
gwfj
by New Contributor
  • 1246 Views
  • 2 replies
  • 0 kudos

Retrieved Docs in Message History

Hi,I've deployed a Langchain model via MLFlow log model and a deployment agent (following this https://notebooks.databricks.com/demos/llm-rag-chatbot/index.html#)How do I add additional content to the message history for example, I'd like to add retr...

  • 1246 Views
  • 2 replies
  • 0 kudos
Latest Reply
Brian-Nowak
New Contributor II
  • 0 kudos

Hi @davidhuang thanks for pointing to that demo! That implementation of chat history did work in my experience, but it's a little simplistic and could be token-intensive if the history needs to be maintained as a list like that. Has Databricks done a...

  • 0 kudos
1 More Replies