cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
chunky35
by • New Contributor
  • 903 Views
  • 1 replies
  • 1 kudos

Resolved! streaming llm response

I am deploying an agent that works good withouth streaming:it is using the following packages:      "mlflow==2.22.1",      "langgraph",      "langchain",      "pydantic==2.8.2",      "langgraph-checkpoint-sqlite",      "databricks-langchain",      "p...

Generative AI
Reply
  • 903 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
mark_ott
Databricks Employee
  • 1 kudos

To implement streaming output for your agent in Databricks and resolve the error "This model does not support predict_stream method.", the key requirement is that your underlying MLflow model must support the predict_stream method. Most l...

  • 1 kudos
Labels