cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Request for Genie Agent Mode API with Streaming & Reasoning Trace Support

asfriz
Visitor

Hi everyone,

Genie Agent Mode has been incredibly impressive and is one of the best tools weโ€™ve come across, especially in how it handles multi-step reasoning and delivers structured end-to-end insights.

Weโ€™re currently building a frontend application and would love to use Genie Agent Mode as the backend engine. However, weโ€™ve hit a key limitation:

Agent Mode is not available via API, and its capabilities are restricted to the UI.

What we need

To integrate this into a production application, weโ€™re specifically looking for:

1. Agent Mode API access

- Ability to send prompts programmatically
- Execute full Agent workflows outside the UI

2. Reasoning trace / intermediate steps

Structured breakdown of the agentโ€™s internal process, including:

- Question understanding
- Query generation
- Iterative refinement steps
- Final answer synthesis
- Additionally, lightweight status updates during execution such as:

โ€œUnderstanding questionโ€ฆโ€
โ€œRunning queriesโ€ฆโ€
โ€œAnalyzing resultsโ€ฆโ€

These intermediate updates are extremely valuable for frontend UX and transparency.

3. Streaming support (real-time response)

- Responses delivered in incremental chunks (similar to a typing effect) rather than a single final response
- Ability to stream partial outputs to the frontend 
- This allows users to:

- See answers forming in real time
- Stay engaged during longer-running queries
- Combine streamed output with live status updates

Genie Conversation APIs are helpful, but they donโ€™t replicate the multi-step reasoning and iterative behavior of Agent Mode.

This would unlock a huge opportunity to build real-time data applications directly on Databricks.

Would love to know if this is on the roadmap.

Thanks!

0 REPLIES 0