cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by • Databricks Employee
  • 41241 Views
  • 23 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 41241 Views
  • 23 replies
  • 51 kudos
Latest Reply
ChiranjeeviKudu
New Contributor III
  • 51 kudos

Thanks for sharing.

  • 51 kudos
22 More Replies
Sanjeeb2024
by • Valued Contributor II
  • 1029 Views
  • 4 replies
  • 4 kudos

Resolved! Genie - Cost monitoring and usage

Hi Team,Genie is widely used within our department, and we would like to establish appropriate governance around its usage. Do we have any existing guidelines or recommended practices for this? In particular, we are looking for guidance on:Cost monit...

  • 1029 Views
  • 4 replies
  • 4 kudos
Latest Reply
Sanjeeb2024
Valued Contributor II
  • 4 kudos

Thank you so much details. These are very useful details. I used Genie code to create a notebook which provide all details on the Genie cost, using those details I created a dashboard for monitoring and it provided the require details as of now, slow...

  • 4 kudos
3 More Replies
rquezada
by • New Contributor II
  • 1304 Views
  • 3 replies
  • 2 kudos

Azure Databricks Genie + Copilot Studio: MCP tools discovered and enabled, but Copilot never invokes

Hi everyone,I'm trying to integrate an Azure Databricks Genie Agent with Microsoft Copilot Studio through the MCP integration, and I'm stuck in a situation where everything appears correctly configured, but Copilot never actually invokes the Genie to...

  • 1304 Views
  • 3 replies
  • 2 kudos
Latest Reply
DoTA
Valued Contributor II
  • 2 kudos

@tdcouto That split (new UI broken, legacy UI fine) actually lines up with the harness distinction from my note above. The two Copilot Studio UIs aren't just a skin difference, the new UI runs agents on a different underlying orchestration runtime (t...

  • 2 kudos
2 More Replies
khanzada
by • New Contributor
  • 439 Views
  • 2 replies
  • 0 kudos

Enterprise workspace blocked by Databricks-set rate limit of 0 on all models (AWS Marketplace)

I'm on an Enterprise plan (billed via AWS Marketplace, active payment method, $399 credit remaining) and every model in my Unity AI Gateway — glm-5-3-flash, claude-opus-5, grok-4-6, gpt-5-6-sol, etc. — returns:"error_code":"PERMISSION_DENIED","messag...

  • 439 Views
  • 2 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

@khanzada This is the same trust-tier gate as the earlier thread here: https://community.databricks.com/t5/generative-ai/premium-pay-as-you-go-account-still-blocked-by-databricks-set/td-p/166879 - it's not a per-model rate limit, a budget, or your pl...

  • 0 kudos
1 More Replies
LeMi-1
by • New Contributor
  • 383 Views
  • 1 replies
  • 0 kudos

Premium pay-as-you-go account still blocked by Databricks-set rate limit of 0

Hello,I’m having an issue using the Databricks Foundation Model API.My account is on the Premium plan, I have a valid payment method attached, and I currently have trial credits available. However, when I try to use the GLM Foundation Model endpoint,...

  • 383 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

A community reply cannot lift the limit - that trust-tier change is Databricks-side only - but a few things that may help. What is happening: pay-per-token Foundation Model endpoints are gated to PAYABLE_VERIFIED workspaces. Attaching a card does not...

  • 0 kudos
mramanindia
by • New Contributor II
  • 700 Views
  • 3 replies
  • 0 kudos

Genie Agent content search on a managed volume fails with "The request was invalid"

Hi all, I am trying to enable content search on a Unity Catalog managed volume so a Genie Agent can answer questions over PDFs. The Enable action fails every time with: "Failed to update content search - The request was invalid." Environment: AWS, eu...

  • 700 Views
  • 3 replies
  • 0 kudos
Latest Reply
mramanindia
New Contributor II
  • 0 kudos

Thanks both, very helpful. Two updates. First, a correction on my side: the workspace is in us-east-2, not London, so cross-Geo processing should not have been required for this region. Second, I checked the workspace Security and compliance tab anyw...

  • 0 kudos
2 More Replies
VibinRoy_C
by • New Contributor III
  • 500 Views
  • 3 replies
  • 0 kudos

Databricks-Native AI Agent for Job Incident Detection, RCA & Safe Remediation

I’m exploring an architecture for a Databricks-native AI Agent for intelligent Spark job incident detection, root cause analysis (RCA), and safe remediation, and I would love your technical feedback.The ProblemA common operational challenge is the "S...

  • 500 Views
  • 3 replies
  • 0 kudos
Latest Reply
ivanvyd
New Contributor III
  • 0 kudos

@VibinRoy_C  the key limitation is telemetry latency: system.lakeflow.job_run_timeline and job_task_run_timeline are useful for baselines, but records typically arrive within an hour. system.compute.node_timeline adds minute-level metrics for classic...

  • 0 kudos
2 More Replies
Abhishek_Patel
by • Databricks Partner
  • 7069 Views
  • 14 replies
  • 10 kudos

Resolved! AgentBricks - Multi Agent Supervisor Issue

Hi, I am doing POC using AgentBricks and using Multi Agent Supervisor. I have configured 2 subagents.1. Genie Space2. UC Function to call LLM3. UC Function to plot chartsHowever, the agent is able to access and use only Genie space agent and not usin...

  • 7069 Views
  • 14 replies
  • 10 kudos
Latest Reply
Anupam_Patil
New Contributor II
  • 10 kudos

We have a Unity Catalog SQL function that is scalar, takes one STRING parameter, returns STRING, and reads a single Delta table. It works when called directly in the SQL editor. Registered as the only tool on an Agent Bricks Supervisor agent, every c...

  • 10 kudos
13 More Replies
HariUmeshNaraya
by • New Contributor II
  • 553 Views
  • 3 replies
  • 2 kudos

Can Unity AI Gateway Model Service guardrails protect an existing LangGraph agent deployed as a Data

I have a LangGraph agent deployed as a Unity Catalog model on aDatabricks Serving Endpoint.Architecture:User↓Databricks Serving Endpoint↓UC Model: ai_workspace.agent.agent↓LangGraph agent↓LLM + toolsThe serving endpoint shows "AI Gateway enabled", bu...

  • 553 Views
  • 3 replies
  • 2 kudos
Latest Reply
GuyBourne
Databricks Employee
  • 2 kudos

AI Gateway Model Service guardrails are scoped to Databricks-hosted foundation models and external LLM endpoints, not to custom UC-registered models or agent-serving endpoints. The "AI Gateway enabled" flag on your endpoint provides usage tracking an...

  • 2 kudos
2 More Replies
Sujitha
by • Databricks Employee
  • 41241 Views
  • 23 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 41241 Views
  • 23 replies
  • 51 kudos
Latest Reply
ChiranjeeviKudu
New Contributor III
  • 51 kudos

Thanks for sharing.

  • 51 kudos
22 More Replies
exrwebflowai
by • New Contributor
  • 451 Views
  • 1 replies
  • 0 kudos

Best Practices for Deploying Custom LLM Pipelines on Databricks?

Hi community,We are currently designing an enterprise-grade LLM pipeline on Databricks to handle end-to-end data processing, model fine-tuning, and inference serving.While Spark handles our data orchestration effectively, we are looking at optimizing...

  • 451 Views
  • 1 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

@exrwebflowai Model Serving and Routing Architecture Hybrid setup anchored by Databricks Model Serving / Unity AI Gateway gives the best balance between deterministic latency and governance for production workloads. Use Provisioned Throughput endpoin...

  • 0 kudos
GauriBhogle
by • New Contributor III
  • 563 Views
  • 1 replies
  • 1 kudos

How Can a Databricks App Render the Same Detailed Response as the Genie UI?

I’m building a Databricks App with a Genie Space at the core and have run into a difference between the Genie UI and the Genie Conversation API.For the same business question, the Genie web UI can produce a detailed response containing an executive s...

  • 563 Views
  • 1 replies
  • 1 kudos
Latest Reply
DoTA
Valued Contributor II
  • 1 kudos

Checked the current Genie REST API reference for this rather than guessing, a few concrete answers. Query attachment result data: GET /api/2.0/genie/spaces/{space_id}/conversations/{conversation_id}/messages/{message_id}/attachments/{attachment_id}/q...

  • 1 kudos
ncastagnet_mc
by • New Contributor II
  • 379 Views
  • 1 replies
  • 0 kudos

Agent mode: will per-turn context reporting be added, or is there another way to read it?

Genie spaces are steered by a semantic layer: text instructions (e.g. "when the user says 'sales', always filter to region = 'EMEA'") and example question→SQL pairs.We read turn payloads programmatically — via the message endpoint behind the Genie UI...

  • 379 Views
  • 1 replies
  • 0 kudos
Latest Reply
DoTA
Valued Contributor II
  • 0 kudos

Checked the current Agent mode Responses API docs on this (docs.databricks.com/aws/en/genie-agents/api) and your read looks right, not a gap in your search. The response stream only documents four output item types: reasoning, function_call, function...

  • 0 kudos
taniumalloy
by • New Contributor III
  • 771 Views
  • 2 replies
  • 1 kudos

Resolved! Custom Agent traces only showing basic input and output

I've been working with MLflow Agent Server deployments using the OpenAI Agents SDK hosted both locally and in Databricks Apps. Currently, tracing is instrumented with:set_trace_processors([]) mlflow.openai.autolog()Locally, everything works great and...

taniumalloy_0-1787599425876.png taniumalloy_1-1787599561475.png
  • 771 Views
  • 2 replies
  • 1 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 1 kudos

@taniumalloy Unity Catalog trace storage provides additional benefits beyond trace detail - unlimited storage, queryability for analysis and debugging, Unity Catalog governance and permissions and compatibility with the latest features. Trace richnes...

  • 1 kudos
1 More Replies
GunaR
by • Contributor
  • 6580 Views
  • 13 replies
  • 3 kudos

Resolved! RLS in Genie Space

I am developing a Conversational BI Solution using Genie. There are users from different roles and we need to restrict the rows returned based on the user's role. Typically RLS. I understand from documentation Genie leverage the RLS setup on the Unit...

  • 6580 Views
  • 13 replies
  • 3 kudos
Latest Reply
AmeetZ
New Contributor III
  • 3 kudos

This post explains the solution to your problem.Multi-Tenant Genie Spaces: Working Demo | by Rohit Bhagwat | Medium

  • 3 kudos
12 More Replies
Labels