cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Genie Agent Mode Visibility vs Standard Mode Monitoring

simmitil
Visitor

In standard Genie Space chat, space managers can use the Monitoring tab to review prompts/conversations. However, in Agent Mode, we see the warning:

โ€œGenie agent responses may contain results obtained using other usersโ€™ credentials and are hidden from space managers.โ€

A few questions:

  1. Why is Agent Mode treated differently from standard Genie chat if both are ultimately querying the same underlying tables/data assets?
  2. Is there currently any admin/workspace setting, governance control, or future roadmap item that would allow space managers to have fuller visibility into Agent Mode conversations/results for testing and governance purposes?
  3. Do benchmarks, thumbs up/down feedback, and saved benchmark questions improve/tune both standard mode and Agent Mode behavior equally, or are they handled separately?

Would appreciate any clarification from anyone who has implemented governance/testing processes around Genie Agent Mode. Thank you!!

0 REPLIES 0