- 895 Views
- 1 replies
- 1 kudos
Resolved! streaming llm response
I am deploying an agent that works good withouth streaming:it is using the following packages: "mlflow==2.22.1", "langgraph", "langchain", "pydantic==2.8.2", "langgraph-checkpoint-sqlite", "databricks-langchain", "p...
- 895 Views
- 1 replies
- 1 kudos
- 1 kudos
To implement streaming output for your agent in Databricks and resolve the error "This model does not support predict_stream method.", the key requirement is that your underlying MLflow model must support the predict_stream method. Most l...
- 1 kudos
- 5329 Views
- 10 replies
- 7 kudos
Resolved! Insufficient Permission Error When Serving RAG Model with Multiple Vector Search Indexes
Hi Community,I’m currently working on a Retrieval-Augmented Generation (RAG) use case in Databricks. I’ve successfully implemented and served a model that uses a single Vector Search index, and everything works as expected.However, when I try to serv...
- 5329 Views
- 10 replies
- 7 kudos
