cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Retrieved Docs in Message History

gwfj
New Contributor

Hi,

I've deployed a Langchain model via MLFlow log model and a deployment agent (following this https://notebooks.databricks.com/demos/llm-rag-chatbot/index.html#)

How do I add additional content to the message history for example, I'd like to add retrieved docs to the chat_history so that the LLM is aware of past retrievals. 

I've had a look at Langchain's doc on adding chat history (https://python.langchain.com/v0.2/docs/how_to/qa_chat_history_how_to/) but I am not too sure whether this will work with MLFlow. 

Do you have any tips/documentation I can refer to? Any assistance is appreciated. Thanks!

Gary

2 REPLIES 2

davidhuang
Databricks Employee
Databricks Employee

In the notebook `02-Advanced-Chatbot-Chain`, from the RAG demo notebooks, shows how to incorporate chat history.

dh

Brian-Nowak
New Contributor II

Hi @davidhuang thanks for pointing to that demo! That implementation of chat history did work in my experience, but it's a little simplistic and could be token-intensive if the history needs to be maintained as a list like that. Has Databricks done any demos / POCs on using LangGraph for stateful management of chat history? Reference to the tutorial here 

I am trying to implement this but the blocker I'm currently facing is I can't figure out how to pass a thread_id or other config data into the graph from the Model Serving Endpoint. Any chance you've tackled this? Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group