- 42210 Views
- 24 replies
- 51 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 42210 Views
- 24 replies
- 51 kudos
- 51 kudos
Great initiative by Databricks! This is a valuable opportunity to build practical GenAI skills and stay ahead in the rapidly evolving AI space.
- 51 kudos
- 564 Views
- 2 replies
- 2 kudos
Power of Genie
Folks, I must admit, at the beginning I was apprehensive of using Genie for almost anything. Now it solves almost anything that I want to code on Databricks. I was more fascinated with it when I learnt that our customer (who is one of the largest Tel...
- 564 Views
- 2 replies
- 2 kudos
- 2 kudos
Surya, good to read this, and I get the initial hesitation. We had the same reaction on our side a year ago.What changed the picture for us wasn't Genie getting smarter on its own, it was what we put around it. Once we added clear instructions per sp...
- 2 kudos
- 2979 Views
- 2 replies
- 1 kudos
Resolved! Foundation Models API blocked — "Databricks-set rate limit of 0" even after adding payment method
I'm trying to use the Foundation Models API (databricks-claude-opus-4-8) in my workspace but every call returns this error:PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0.This happens both from notebook...
- 2979 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi, this one isn't fixable from the endpoint or AI Gateway settings, even though it looks like a rate limit you should be able to just raise. That "Databricks-set rate limit of 0" is a workspace trust tier restriction, not the rate limit you configur...
- 1 kudos
- 323 Views
- 0 replies
- 0 kudos
Before dropping a column, check whether Genie has been using it
I was reviewing a schema change recently and wanted a quick answer to a simple question:Could this column be used by a Genie Agent somewhere without me realizing it?There's now a pretty useful way to check I want to share with you.Databricks' March 2...
- 323 Views
- 0 replies
- 0 kudos
- 1685 Views
- 4 replies
- 4 kudos
Resolved! Genie - Cost monitoring and usage
Hi Team,Genie is widely used within our department, and we would like to establish appropriate governance around its usage. Do we have any existing guidelines or recommended practices for this? In particular, we are looking for guidance on:Cost monit...
- 1685 Views
- 4 replies
- 4 kudos
- 4 kudos
Thank you so much details. These are very useful details. I used Genie code to create a notebook which provide all details on the Genie cost, using those details I created a dashboard for monitoring and it provided the require details as of now, slow...
- 4 kudos
- 1773 Views
- 3 replies
- 2 kudos
Azure Databricks Genie + Copilot Studio: MCP tools discovered and enabled, but Copilot never invokes
Hi everyone,I'm trying to integrate an Azure Databricks Genie Agent with Microsoft Copilot Studio through the MCP integration, and I'm stuck in a situation where everything appears correctly configured, but Copilot never actually invokes the Genie to...
- 1773 Views
- 3 replies
- 2 kudos
- 2 kudos
@tdcouto That split (new UI broken, legacy UI fine) actually lines up with the harness distinction from my note above. The two Copilot Studio UIs aren't just a skin difference, the new UI runs agents on a different underlying orchestration runtime (t...
- 2 kudos
- 621 Views
- 2 replies
- 0 kudos
Enterprise workspace blocked by Databricks-set rate limit of 0 on all models (AWS Marketplace)
I'm on an Enterprise plan (billed via AWS Marketplace, active payment method, $399 credit remaining) and every model in my Unity AI Gateway — glm-5-3-flash, claude-opus-5, grok-4-6, gpt-5-6-sol, etc. — returns:"error_code":"PERMISSION_DENIED","messag...
- 621 Views
- 2 replies
- 0 kudos
- 0 kudos
@khanzada This is the same trust-tier gate as the earlier thread here: https://community.databricks.com/t5/generative-ai/premium-pay-as-you-go-account-still-blocked-by-databricks-set/td-p/166879 - it's not a per-model rate limit, a budget, or your pl...
- 0 kudos
- 525 Views
- 1 replies
- 0 kudos
Premium pay-as-you-go account still blocked by Databricks-set rate limit of 0
Hello,I’m having an issue using the Databricks Foundation Model API.My account is on the Premium plan, I have a valid payment method attached, and I currently have trial credits available. However, when I try to use the GLM Foundation Model endpoint,...
- 525 Views
- 1 replies
- 0 kudos
- 0 kudos
A community reply cannot lift the limit - that trust-tier change is Databricks-side only - but a few things that may help. What is happening: pay-per-token Foundation Model endpoints are gated to PAYABLE_VERIFIED workspaces. Attaching a card does not...
- 0 kudos
- 929 Views
- 3 replies
- 0 kudos
Genie Agent content search on a managed volume fails with "The request was invalid"
Hi all, I am trying to enable content search on a Unity Catalog managed volume so a Genie Agent can answer questions over PDFs. The Enable action fails every time with: "Failed to update content search - The request was invalid." Environment: AWS, eu...
- 929 Views
- 3 replies
- 0 kudos
- 0 kudos
Thanks both, very helpful. Two updates. First, a correction on my side: the workspace is in us-east-2, not London, so cross-Geo processing should not have been required for this region. Second, I checked the workspace Security and compliance tab anyw...
- 0 kudos
- 679 Views
- 3 replies
- 0 kudos
Databricks-Native AI Agent for Job Incident Detection, RCA & Safe Remediation
I’m exploring an architecture for a Databricks-native AI Agent for intelligent Spark job incident detection, root cause analysis (RCA), and safe remediation, and I would love your technical feedback.The ProblemA common operational challenge is the "S...
- 679 Views
- 3 replies
- 0 kudos
- 0 kudos
@VibinRoy_C the key limitation is telemetry latency: system.lakeflow.job_run_timeline and job_task_run_timeline are useful for baselines, but records typically arrive within an hour. system.compute.node_timeline adds minute-level metrics for classic...
- 0 kudos
- 7443 Views
- 14 replies
- 10 kudos
Resolved! AgentBricks - Multi Agent Supervisor Issue
Hi, I am doing POC using AgentBricks and using Multi Agent Supervisor. I have configured 2 subagents.1. Genie Space2. UC Function to call LLM3. UC Function to plot chartsHowever, the agent is able to access and use only Genie space agent and not usin...
- 7443 Views
- 14 replies
- 10 kudos
- 10 kudos
We have a Unity Catalog SQL function that is scalar, takes one STRING parameter, returns STRING, and reads a single Delta table. It works when called directly in the SQL editor. Registered as the only tool on an Agent Bricks Supervisor agent, every c...
- 10 kudos
- 753 Views
- 3 replies
- 2 kudos
Can Unity AI Gateway Model Service guardrails protect an existing LangGraph agent deployed as a Data
I have a LangGraph agent deployed as a Unity Catalog model on aDatabricks Serving Endpoint.Architecture:User↓Databricks Serving Endpoint↓UC Model: ai_workspace.agent.agent↓LangGraph agent↓LLM + toolsThe serving endpoint shows "AI Gateway enabled", bu...
- 753 Views
- 3 replies
- 2 kudos
- 2 kudos
AI Gateway Model Service guardrails are scoped to Databricks-hosted foundation models and external LLM endpoints, not to custom UC-registered models or agent-serving endpoints. The "AI Gateway enabled" flag on your endpoint provides usage tracking an...
- 2 kudos
- 606 Views
- 1 replies
- 0 kudos
Best Practices for Deploying Custom LLM Pipelines on Databricks?
Hi community,We are currently designing an enterprise-grade LLM pipeline on Databricks to handle end-to-end data processing, model fine-tuning, and inference serving.While Spark handles our data orchestration effectively, we are looking at optimizing...
- 606 Views
- 1 replies
- 0 kudos
- 0 kudos
@exrwebflowai Model Serving and Routing Architecture Hybrid setup anchored by Databricks Model Serving / Unity AI Gateway gives the best balance between deterministic latency and governance for production workloads. Use Provisioned Throughput endpoin...
- 0 kudos
- 849 Views
- 1 replies
- 1 kudos
How Can a Databricks App Render the Same Detailed Response as the Genie UI?
I’m building a Databricks App with a Genie Space at the core and have run into a difference between the Genie UI and the Genie Conversation API.For the same business question, the Genie web UI can produce a detailed response containing an executive s...
- 849 Views
- 1 replies
- 1 kudos
- 1 kudos
Checked the current Genie REST API reference for this rather than guessing, a few concrete answers. Query attachment result data: GET /api/2.0/genie/spaces/{space_id}/conversations/{conversation_id}/messages/{message_id}/attachments/{attachment_id}/q...
- 1 kudos
- 504 Views
- 1 replies
- 0 kudos
Agent mode: will per-turn context reporting be added, or is there another way to read it?
Genie spaces are steered by a semantic layer: text instructions (e.g. "when the user says 'sales', always filter to region = 'EMEA'") and example question→SQL pairs.We read turn payloads programmatically — via the message endpoint behind the Genie UI...
- 504 Views
- 1 replies
- 0 kudos
- 0 kudos
Checked the current Agent mode Responses API docs on this (docs.databricks.com/aws/en/genie-agents/api) and your read looks right, not a gap in your search. The response stream only documents four output item types: reasoning, function_call, function...
- 0 kudos
- 1062 Views
- 2 replies
- 1 kudos
Resolved! Custom Agent traces only showing basic input and output
I've been working with MLflow Agent Server deployments using the OpenAI Agents SDK hosted both locally and in Databricks Apps. Currently, tracing is instrumented with:set_trace_processors([]) mlflow.openai.autolog()Locally, everything works great and...
- 1062 Views
- 2 replies
- 1 kudos
- 1 kudos
@taniumalloy Unity Catalog trace storage provides additional benefits beyond trace detail - unlimited storage, queryability for analysis and debugging, Unity Catalog governance and permissions and compatibility with the latest features. Trace richnes...
- 1 kudos
