cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by • Databricks Employee
  • 41433 Views
  • 23 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 41433 Views
  • 23 replies
  • 51 kudos
Latest Reply
ChiranjeeviKudu
New Contributor III
  • 51 kudos

Thanks for sharing.

  • 51 kudos
22 More Replies
GauriBhogle
by • New Contributor III
  • 632 Views
  • 1 replies
  • 1 kudos

How Can a Databricks App Render the Same Detailed Response as the Genie UI?

I’m building a Databricks App with a Genie Space at the core and have run into a difference between the Genie UI and the Genie Conversation API.For the same business question, the Genie web UI can produce a detailed response containing an executive s...

  • 632 Views
  • 1 replies
  • 1 kudos
Latest Reply
DoTA
Valued Contributor II
  • 1 kudos

Checked the current Genie REST API reference for this rather than guessing, a few concrete answers. Query attachment result data: GET /api/2.0/genie/spaces/{space_id}/conversations/{conversation_id}/messages/{message_id}/attachments/{attachment_id}/q...

  • 1 kudos
ncastagnet_mc
by • New Contributor II
  • 403 Views
  • 1 replies
  • 0 kudos

Agent mode: will per-turn context reporting be added, or is there another way to read it?

Genie spaces are steered by a semantic layer: text instructions (e.g. "when the user says 'sales', always filter to region = 'EMEA'") and example question→SQL pairs.We read turn payloads programmatically — via the message endpoint behind the Genie UI...

  • 403 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

Checked the current Agent mode Responses API docs on this (docs.databricks.com/aws/en/genie-agents/api) and your read looks right, not a gap in your search. The response stream only documents four output item types: reasoning, function_call, function...

  • 0 kudos
taniumalloy
by • New Contributor III
  • 828 Views
  • 2 replies
  • 1 kudos

Resolved! Custom Agent traces only showing basic input and output

I've been working with MLflow Agent Server deployments using the OpenAI Agents SDK hosted both locally and in Databricks Apps. Currently, tracing is instrumented with:set_trace_processors([]) mlflow.openai.autolog()Locally, everything works great and...

taniumalloy_0-1787599425876.png taniumalloy_1-1787599561475.png
  • 828 Views
  • 2 replies
  • 1 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 1 kudos

@taniumalloy Unity Catalog trace storage provides additional benefits beyond trace detail - unlimited storage, queryability for analysis and debugging, Unity Catalog governance and permissions and compatibility with the latest features. Trace richnes...

  • 1 kudos
1 More Replies
GunaR
by • Contributor
  • 6716 Views
  • 13 replies
  • 3 kudos

Resolved! RLS in Genie Space

I am developing a Conversational BI Solution using Genie. There are users from different roles and we need to restrict the rows returned based on the user's role. Typically RLS. I understand from documentation Genie leverage the RLS setup on the Unit...

  • 6716 Views
  • 13 replies
  • 3 kudos
Latest Reply
AmeetZ
New Contributor III
  • 3 kudos

This post explains the solution to your problem.Multi-Tenant Genie Spaces: Working Demo | by Rohit Bhagwat | Medium

  • 3 kudos
12 More Replies
APIUser4827
by • New Contributor
  • 755 Views
  • 1 replies
  • 0 kudos

Databricks-hosted Foundation Model APIs blocked by workspace rate limit of 0

Hello,My Databricks-hosted Foundation Model endpoints appear READY, but every runtime invocation is blocked by a workspace-level quota.Workspace details:- Workspace ID: 7474647458172567- Workspace URL: https://dbc-731cb41b-741e.cloud.databricks.com- ...

  • 755 Views
  • 1 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

@APIUser4827 What you are encountering is the expected behavior in free edition. Databricks imposes a hard limit of 0 on premium, high demand Foundation Models especially - Claude and GPT groups when a workspace is operating under a free edition.You ...

  • 0 kudos
appliable_ai
by • New Contributor II
  • 1429 Views
  • 5 replies
  • 0 kudos

Failed to save agent Supervisor Agent is not available. To access this feature, please contact sales

Hello,I am trying to create a Supervisor Agent via the web UI, and when starting to try and use it I get the errorFailed to save agent Supervisor Agent is not available. To access this feature, please contact salesThis is despite this preview being e...

appliable_ai_0-1782911899560.png appliable_ai_1-1782911959746.png
  • 1429 Views
  • 5 replies
  • 0 kudos
Latest Reply
Armanillo_RoK
New Contributor III
  • 0 kudos

Well @appliable_ai  then you might want to open a support ticket/contact your Databricks account team and ask them to enable/fix the Supervisor Agent entitlement on workspace. It works for me, but if I remember correctly I had to reach out to the our...

  • 0 kudos
4 More Replies
aryan_s1977
by • New Contributor II
  • 585 Views
  • 3 replies
  • 2 kudos

Endpoint Error

I have a GCP Databricks account on the Enterprise plan with GCP Marketplace configured as the default payment method. Partner-powered AI features are enabled, and we enabled the Supervisor API Beta preview. Unity Catalog v3 model services are visible...

  • 585 Views
  • 3 replies
  • 2 kudos
Latest Reply
aryan_s1977
New Contributor II
  • 2 kudos

Hey, thanks for replying! I'm not really sure how to upgrade 'further' from what I can currently see under the 'Billing' section of my workplace, screenshot for the same is attached; your advice would be really helpful!

  • 2 kudos
2 More Replies
data_architect2
by • New Contributor III
  • 906 Views
  • 1 replies
  • 0 kudos

Resolved! Bedrock and Genie

Genie expertsWe are planning to utilize the AWS Bedrock agent to work with Genie One and invoke endpoints within Databricks. Our setup will involve multiple Databricks  accounts that will be integrated with the Bedrock agent. I would appreciate any g...

  • 906 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

A few practical patterns/gotchas that tend to matter for this kind of setup: 1. Bedrock doesn't have a native Genie connector, so the usual approach is to implement the call as a Bedrock Agent action group backed by a Lambda function. The Lambda wrap...

  • 0 kudos
Jeff_Zhang
by • New Contributor III
  • 1771 Views
  • 5 replies
  • 4 kudos

[Genie] Format assistance & entity match doesn't work for me

I enable format assistance & entity match for some table fields in my genie space. But it looks like it doesn't work. e.g. the following field is categorical and I enable format assistance & entity match for it. The following is the generated sql: mo...

  • 1771 Views
  • 5 replies
  • 4 kudos
Latest Reply
mckohnen
New Contributor II
  • 4 kudos

@pavannaidu I would like to reopen this issue, as I have faced similar problems (and yes I made sure to enable it properly, toggling off and saving, toggling on and saving again, etc.). For Genie Agent in Chat Mode, when going into the thinking proce...

  • 4 kudos
4 More Replies
Yuki
by • Contributor
  • 476 Views
  • 2 replies
  • 1 kudos

Questions about "Store OpenTelemetry traces in Unity Catalog"

Hi,I'm trying to use the OpenTelemetry traces in Unity Catalog https://docs.databricks.com/aws/en/mlflow3/genai/tracing/trace-unity-catalogBut I'm having trouble to understand the behavior.First, I can't find any data in the following two tables.<tab...

  • 476 Views
  • 2 replies
  • 1 kudos
Latest Reply
cartergray70543
Contributor II
  • 1 kudos

The _otel_logs and _otel_metrics tables may remain empty if your traces are stored primarily in the spans table. Check _otel_spans first and verify that the UC trace storage and permissions are configured correctly.For a new setup, use Unity Catalog ...

  • 1 kudos
1 More Replies
shrm80
by • New Contributor II
  • 698 Views
  • 5 replies
  • 0 kudos

facing issue in llm models

i have signed up to databricks using aws but when i try to access model i m getting error Error (403): PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0.

  • 698 Views
  • 5 replies
  • 0 kudos
Latest Reply
snehamore811
Databricks Partner
  • 0 kudos

Yes. If you have already upgraded from the Free Trial to Enterprise and the error is still exactly Databricks-set rate limit of 0, then changing the QPM/TPM limit in the UI is not going to fix it.I checked the current Databricks documentation and rec...

  • 0 kudos
4 More Replies
Santhosh_23
by • New Contributor II
  • 293 Views
  • 1 replies
  • 0 kudos

Genie Agent Volume Attachment (Beta) Docs mentions multiple formats but images aren't supported

Hi Databricks Team,I'm testing the Genie Agent volume attachment feature (Beta) and have a question regarding supported file formats.According to the documentation, Genie Agents can be attached to a Volume containing various file formats. The support...

  • 293 Views
  • 1 replies
  • 0 kudos
Latest Reply
Santhosh_23
New Contributor II
  • 0 kudos

Sorry about that; it looks like a UI bug.

  • 0 kudos
IM_01
by • Valued Contributor
  • 667 Views
  • 2 replies
  • 2 kudos

Databricks Knowledge Assistant

Hi All,I've been exploring Knowledge Assistant and trying to understand how it works under the hood. I noticed it's built on the Instructed Retriever architecture, and I recently came across an update called Instructed-Retriever-1, which is supposed ...

  • 667 Views
  • 2 replies
  • 2 kudos
Latest Reply
IM_01
Valued Contributor
  • 2 kudos

@suryaprayaga , I see the instructed-retriever-1 generates pair of query & filter, there can be filters that vector-index does not contain, what all metadata fields are persisted on vector-index , in case of llama-index we define the metadata columns...

  • 2 kudos
1 More Replies
FreshBrewedData
by • New Contributor II
  • 6141 Views
  • 5 replies
  • 3 kudos

Testing ai_parse_document vs PyMuPDF for PDF extraction

I’ve been experimenting with the Databricks AI functions and recently ran a small test extracting structured information from a PDF document.My initial approach was to use ai_parse_document to extract the text from the PDF.While the function appeared...

  • 6141 Views
  • 5 replies
  • 3 kudos
Latest Reply
LucasFazzi
New Contributor II
  • 3 kudos

Great points here! I'm using a similar hybrid approach in production:PyMuPDF runs on everything first, it extracts native text from digital PDFs (fast, free, zero AI cost). Any PDF that returns no text gets tagged as needs_ocr.Only the needs_ocr docu...

  • 3 kudos
4 More Replies
Brahmareddy
by • Esteemed Contributor II
  • 796 Views
  • 3 replies
  • 1 kudos

Building an Agentic HR Front Door on Databricks

I have been exploring one question for the last few months:What happens when enterprise AI moves from answering questions to actually completing tasks?That led me to build DwaraOne, an agentic HR front door using Databricks free edition.Most HR assis...

  • 796 Views
  • 3 replies
  • 1 kudos
Latest Reply
kartikchoudhary
Contributor
  • 1 kudos

Interesting to see the shift from AI assistants that answer questions to agents that can actually complete tasks. For enterprise adoption, I’m curious how teams are thinking about measuring business impact here — is the focus more on reducing manual ...

  • 1 kudos
2 More Replies
Labels