cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 38415 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 38415 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
Fortinbras
by New Contributor II
  • 601 Views
  • 1 replies
  • 1 kudos

Resolved! Enforcing Minimum Cohort Size in a Databricks App with AI/BI Genie

Hello, I'm currently building a Databricks App using AppKit and AI/BI Genie to let business users ask natural-language questions over registration and customer-demographic data. For privacy protection, demographic records are currently filtered so th...

  • 601 Views
  • 1 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

There's no built-in Genie feature that enforces a post-join HAVING threshold centrally, so you're right to think about this architecturally. The most reliable pattern in AppKit is to own the query execution layer yourself rather than letting Genie se...

  • 1 kudos
Aakash001
by New Contributor II
  • 1741 Views
  • 3 replies
  • 3 kudos

Resolved! Genie Code CLI support

Hi team,Currently the genie code is available only in the workspace UI. Do we have CLI capabilities for the genie code ? Or is it expected to come in the near future ? Please let me know your thoughts on this. Also, currently we have CLI support for ...

  • 1741 Views
  • 3 replies
  • 3 kudos
Latest Reply
pcmouli
New Contributor II
  • 3 kudos

Snowflake has released their Snowflake Code Assisst - CoCo as CLI. When will databricks release their Genie Code Assist as CLI? We know that Genie Spaces are available as CLI.

  • 3 kudos
2 More Replies
Bitrip007
by New Contributor II
  • 414 Views
  • 1 replies
  • 1 kudos

Governance for vector search across multi domain unstructured data

What is the recommended governance strategy for Databricks Vector Search in an enterprise Unified Data Platform (UDP) where structured and unstructured data from multiple business domains (Sales, Marketing.) is ingested into a common analytics platfo...

  • 414 Views
  • 1 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

The short answer on index architecture: separate indexes per domain is usually the right call for an enterprise setup, not a single shared index with metadata filters. Here's why the "one index with filtering" approach is tempting but fragile. Vector...

  • 1 kudos
mbecker
by New Contributor
  • 758 Views
  • 1 replies
  • 0 kudos

Official databricks-openai package fails to import after resolving databricks-vectorsearch

I filed a detailed GitHub issue here:https://github.com/databricks/databricks-ai-bridge/issues/433Summary:A clean install of `databricks-openai==0.15.0` currently resolves `databricks-vectorsearch==0.74`, after which the documented import fails:```py...

  • 758 Views
  • 1 replies
  • 0 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 0 kudos

Good news, this is already fixed. A Databricks maintainer confirmed the bug on your GitHub issue and shipped databricks-openai==0.16.0 together with databricks-ai-bridge==0.20.0 on June 10 to resolve it. So the actual fix, instead of pinning databric...

  • 0 kudos
sandyveeru
by New Contributor
  • 433 Views
  • 1 replies
  • 0 kudos

Genie not able to list MCP prompts

Hi community,I'm building a custom MCP proxy server (hosted as a Databricks App) that forwards requests to an upstream MCP server. The upstream server exposes both **tools** and **prompts** as per the MCP specification.I can confirm that Genie Code s...

  • 433 Views
  • 1 replies
  • 0 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 0 kudos

This almost always turns out to be st.cache_resource on the connection, not the reverse proxy reusing anything. You said you checked your st.cache_data functions and they key on username, which is the right instinct, but the leak usually hides in wha...

  • 0 kudos
lej6
by New Contributor III
  • 488 Views
  • 1 replies
  • 1 kudos

Resolved! Genie API List Conversations Incomplete

Hello,In my team we have a dashboard that tracks the Genie Answers Quality: the question that was made, the feedback, who made it,... We use the Genie API to extract the conversations of the Genie, write the data into a table, and feed the dashboard ...

  • 488 Views
  • 1 replies
  • 1 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 1 kudos

Genie agents are documented to support up to 10,000 conversations per agent and 10,000 messages per conversation, and the API is designed to retain prior messages as conversation context rather than silently omitting them. More likely causes are: You...

  • 1 kudos
ncastagnet_mc
by New Contributor II
  • 708 Views
  • 2 replies
  • 0 kudos

credential delegation not found (404) / permission delegation name (500)

Hi, We run a monitoring integration that reads a Genie space's conversations via the Conversation API, using a service principal with CAN MANAGE on the space - capturing each conversation's prompt, generated SQL, and query result.Listing conversation...

  • 708 Views
  • 2 replies
  • 0 kudos
Latest Reply
ncastagnet_mc
New Contributor II
  • 0 kudos

Thank you very much, @Lu_Wang_ENB_DBX   — this is really helpful and provides great insights! As a first step, we’ll ask the customer enable Genie chat sharing and check whether our monitoring identity can then read the results. If the 404s/500s pers...

  • 0 kudos
1 More Replies
dkxxx-rc
by Contributor
  • 684 Views
  • 1 replies
  • 0 kudos

Resolved! Order of common questions in genie room

I want to add a set of Common Questions to my genie room as a guideline for users of what functions (i.e., question types) they are encouraged to choose from.  I want it to be like a pseudo-menu, with functions F1, F2, and F3.  The actual questions w...

  • 684 Views
  • 1 replies
  • 0 kudos
Latest Reply
harisrinivasay
Contributor
  • 0 kudos

Unfortunately, not at the moment. I've explored this as well, including the possibility of removing or customizing the menu/action buttons, but there currently isn't any control available for that.The only option is to include a list of suggested que...

  • 0 kudos
Froffri
by New Contributor III
  • 1272 Views
  • 3 replies
  • 2 kudos

Resolved! OBO Authentication with Unity AI Gateway and databricks.agents.deploy()

Hi everyone,I'm trying to use the new Unity AI Gateway v2 (beta) endpoint from an agent deployed with the Mosaic AI Agent Framework and I'm running into what looks like a scope mismatch.Library versionsdatabricks-agents==1.11.0mlflow==3.12.0python~3....

  • 1272 Views
  • 3 replies
  • 2 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 2 kudos

This isn't a config problem on your end, it's a support gap. On-behalf-of auth for the standalone Unity AI Gateway beta endpoint isn't supported yet when you're deploying through databricks.agents.deploy(). Specifically, "ai-gateway" isn't a valid va...

  • 2 kudos
2 More Replies
TX-Aggie-00
by Databricks Partner
  • 953 Views
  • 9 replies
  • 0 kudos

AI Search Endpoint Quota in Azure

I have seen the common responses to most in this thread, so I will get ahead of it by saying that our workspace is not a trial, but a premium workspace in Azure.  I am a global admin in the workspace as well.  It seems like a lot of the AI settings g...

  • 953 Views
  • 9 replies
  • 0 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 0 kudos

Hi, this doesn't appear to be a product limitation. The documented default quota is 500 AI Search endpoints per workspace, and the documentation explicitly notes that this limit can be increased through your account team. Because of that, a Premium w...

  • 0 kudos
8 More Replies
juliopalmeiro
by New Contributor II
  • 1175 Views
  • 1 replies
  • 1 kudos

Resolved! Foundation Models API blocked — "Databricks-set rate limit of 0" even after adding payment method

I'm trying to use the Foundation Models API (databricks-claude-opus-4-8) in my workspace but every call returns this error:PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0.This happens both from notebook...

  • 1175 Views
  • 1 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

Hi, this one isn't fixable from the endpoint or AI Gateway settings, even though it looks like a rate limit you should be able to just raise. That "Databricks-set rate limit of 0" is a workspace trust tier restriction, not the rate limit you configur...

  • 1 kudos
Inument
by New Contributor II
  • 739 Views
  • 1 replies
  • 1 kudos

Resolved! Does "move fast and break things" ruin AI agents?

Is the "move fast and break things" startup mindset actually fatal for custom AI agent development?I read that rushing MVPs creates massive tech debt and unstable guardrails that cause projects to crash by year two.Have any of you hit this "year 2 wa...

  • 739 Views
  • 1 replies
  • 1 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 1 kudos

Well, you can only break things which exist, so if you're delivering an MVP, nothing yet exists to be broken.  This is kind of the wrong mindset, I think you should look at the agile process of "ship fast, ship small, iterate".  Sometimes the iterati...

  • 1 kudos
OliverMini
by Databricks Partner
  • 2037 Views
  • 5 replies
  • 4 kudos

Resolved! How to retrieve Genie's narrative text summary (final_summary) via API?

Dear Databricks Community,I am trying to programmatically access the narrative text summary that Databricks Genie displays in the UI, but I cannot find it in the public API responses.What I see in the UI: When I ask Genie a question, the UI displays ...

  • 2037 Views
  • 5 replies
  • 4 kudos
Latest Reply
tulga-orosoo
New Contributor II
  • 4 kudos

Hey, thank you very much! Confirm the text summary is in the response now.

  • 4 kudos
4 More Replies
Ajay-Pandey
by Databricks MVP
  • 462 Views
  • 2 replies
  • 0 kudos

Agentbricks Knowledge Assistant - Facing Issue with Agent Creation and Source Visibility

Hi Team,I am facing an issue while creating a Knowledge Assistant in the Agent section. It was working fine earlier, and I had uploaded multiple PDF files (70K). However, it has now started behaving unexpectedly.I am not able to see any source data i...

AjayPandey_0-1782362411750.png AjayPandey_1-1782362453412.png AjayPandey_2-1782362563886.png
  • 462 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ajay-Pandey
Databricks MVP
  • 0 kudos

Thanks @Ashwin_DSA I have already tried the provided solution, but I am still facing the error. I have also raised a support request with Azure Databricks; however, it has been going in circles for the past month without resolution.

  • 0 kudos
1 More Replies
suranga
by Databricks Partner
  • 393 Views
  • 1 replies
  • 0 kudos

AI Extract is disabled?

Why is AI Extract is not loading up? im on azure databricks and i have JPEG images in a Databricks Volume. Its on GA but why is it asking to contact sales for this?

  • 393 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @suranga, I have checked this internally. What you're seeing is most likely a workspace availability issue rather than a problem with JPEG files in a Unity Catalog Volume. The public Information Extraction documentation lists a few workspace prere...

  • 0 kudos