cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Request for Genie Agent Mode API with Streaming & Reasoning Trace Support

asfriz
New Contributor II

Hi everyone,

Genie Agent Mode has been incredibly impressive and is one of the best tools we’ve come across, especially in how it handles multi-step reasoning and delivers structured end-to-end insights.

We’re currently building a frontend application and would love to use Genie Agent Mode as the backend engine. However, we’ve hit a key limitation:

Agent Mode is not available via API, and its capabilities are restricted to the UI.

What we need

To integrate this into a production application, we’re specifically looking for:

1. Agent Mode API access

- Ability to send prompts programmatically
- Execute full Agent workflows outside the UI

2. Reasoning trace / intermediate steps

Structured breakdown of the agent’s internal process, including:

- Question understanding
- Query generation
- Iterative refinement steps
- Final answer synthesis
- Additionally, lightweight status updates during execution such as:

“Understanding question…”
“Running queries…”
“Analyzing results…”

These intermediate updates are extremely valuable for frontend UX and transparency.

3. Streaming support (real-time response)

- Responses delivered in incremental chunks (similar to a typing effect) rather than a single final response
- Ability to stream partial outputs to the frontend 
- This allows users to:

- See answers forming in real time
- Stay engaged during longer-running queries
- Combine streamed output with live status updates

Genie Conversation APIs are helpful, but they don’t replicate the multi-step reasoning and iterative behavior of Agent Mode.

This would unlock a huge opportunity to build real-time data applications directly on Databricks.

Would love to know if this is on the roadmap.

Thanks!

0 REPLIES 0