cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Request for Genie Agent Mode API with Streaming & Reasoning Trace Support

asfriz
New Contributor II

Hi everyone,

Genie Agent Mode has been incredibly impressive and is one of the best tools weโ€™ve come across, especially in how it handles multi-step reasoning and delivers structured end-to-end insights.

Weโ€™re currently building a frontend application and would love to use Genie Agent Mode as the backend engine. However, weโ€™ve hit a key limitation:

Agent Mode is not available via API, and its capabilities are restricted to the UI.

What we need

To integrate this into a production application, weโ€™re specifically looking for:

1. Agent Mode API access

- Ability to send prompts programmatically
- Execute full Agent workflows outside the UI

2. Reasoning trace / intermediate steps

Structured breakdown of the agentโ€™s internal process, including:

- Question understanding
- Query generation
- Iterative refinement steps
- Final answer synthesis
- Additionally, lightweight status updates during execution such as:

โ€œUnderstanding questionโ€ฆโ€
โ€œRunning queriesโ€ฆโ€
โ€œAnalyzing resultsโ€ฆโ€

These intermediate updates are extremely valuable for frontend UX and transparency.

3. Streaming support (real-time response)

- Responses delivered in incremental chunks (similar to a typing effect) rather than a single final response
- Ability to stream partial outputs to the frontend 
- This allows users to:

- See answers forming in real time
- Stay engaged during longer-running queries
- Combine streamed output with live status updates

Genie Conversation APIs are helpful, but they donโ€™t replicate the multi-step reasoning and iterative behavior of Agent Mode.

This would unlock a huge opportunity to build real-time data applications directly on Databricks.

Would love to know if this is on the roadmap.

Thanks!

1 REPLY 1

Ankitkalra40
Visitor

Hi Asfriz,

Genie Agent mode is currently unavailable via direct API. This capability is something we are also eagerly waiting for.

For now, you can try building an Agent Supervisor which has your Genie space served as a tool & utilize the orchestrator model to mimic the Genie Agent mode. I know this might not be exactly what you are looking for but we tried this & were able to get significantly better response (both quality & structure) for one of our implementations. 
Since all of this will be managed by mlflow traces & LLM judges, management of intermediate steps will also be relatively easy. Refer to this for more details: Agent Evaluation (MLflow 2) | Databricks on AWS

Also, this new release might be coming sooner than expected with the DAIS going on.

Databricks recently announced 3 new Genie capabilities: https://www.databricks.com/blog/introducing-genie-one-genie-ontology-and-genie-agents 

Would love to connect further on this use case.

Regards,

Ankit