cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by • Databricks Employee
  • 41957 Views
  • 24 replies
  • 51 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 41957 Views
  • 24 replies
  • 51 kudos
Latest Reply
ThiamLee
Contributor III
  • 51 kudos

Great initiative by Databricks! This is a valuable opportunity to build practical GenAI skills and stay ahead in the rapidly evolving AI space.

  • 51 kudos
23 More Replies
shivamrai162
by • New Contributor III
  • 1541 Views
  • 2 replies
  • 0 kudos

Resolved! Agent Bricks Multi Agent Supervisor failing update

Hello,I recently created a Multi Agent supervisor yesterday and it is working fine till date but when i created a second Multi Agent Supervisor assistant, im facing below error: Endpoint update failedFailed to deploy : Quota Exceeded: You've hit the ...

shivamrai162_0-1763468341971.png
  • 1541 Views
  • 2 replies
  • 0 kudos
Latest Reply
shivamrai162
New Contributor III
  • 0 kudos

Thanks Advika, I have deleted some of the endpoints and its working now. Also wanted to know if instead of deleting the endpoint, can I just pause it or scale it to zero to avoid endpoint cost.

  • 0 kudos
1 More Replies
actualhuman_012
by • New Contributor III
  • 4610 Views
  • 3 replies
  • 0 kudos

Resolved! Measuring latency metrics like TTFT, TBT when deploying agents on Databricks

Is there an inbuilt method to measure latency metrics like TTFT, TBT when deploying agents on Databricks? Using MLFlow ChatAgent, ChatDatabricks/OpenAI client(workspace client)What would be the way to measure them in case no inbuilt method exists?

  • 4610 Views
  • 3 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

@actualhuman_012 ,  You’re close: for production observability you can use server‑side tracing when you deploy agents on Databricks, and client‑side instrumentation when the app runs outside; you don’t have to rely only on the client side. What to us...

  • 0 kudos
2 More Replies
epistoteles
by • Databricks Partner
  • 8124 Views
  • 3 replies
  • 1 kudos

Vector search index creation is incredibly slow

I am trying to create a vector search index for a Delta Table using Azure OpenAI embeddings (text-embedding-3-large). The table contains 5000 chunks with approx. 1000 tokens each. The OpenAI embeddings are generated through a Databricks model serving...

  • 8124 Views
  • 3 replies
  • 1 kudos
Latest Reply
amitkumarvish
Databricks Partner
  • 1 kudos

@epistoteles I am also facing the same issue while delta table sync with Index. Could you please share if you have any work around or used some different appoarch to decrease latency.Thanks in advance.

  • 1 kudos
2 More Replies
Mario_D
by • New Contributor III
  • 2192 Views
  • 4 replies
  • 1 kudos

Resolved! Agentic AI Workload Analyzer

Hello Databricks experts,In Automating Best Practices with Agentic AI Workload Analyzer, Krishna Satyavarapu and Nikhil Mishra mentioned  "The Agentic AI Workload Analyzer". Is it known when this will be available.cheersMario  

  • 2192 Views
  • 4 replies
  • 1 kudos
Latest Reply
Thompson2345
New Contributor III
  • 1 kudos

Generative AI is transforming how we handle data and automation. The key challenge now is balancing model creativity with control — ensuring reliable outputs while keeping innovation at the core.

  • 1 kudos
3 More Replies
tsukitsune
by • Databricks Partner
  • 4511 Views
  • 8 replies
  • 4 kudos

Resolved! Agent Bricks - MAS 500 Internal error

Hi Databricks Team / Community,I’m encountering a 500 Internal Server Error when calling an Agent Bricks MAS endpoint in my workspace. The error message is:500 Internal Error. Please try again later. If this issue persists, please contact Databricks ...

  • 4511 Views
  • 8 replies
  • 4 kudos
Latest Reply
shivamrai162
New Contributor III
  • 4 kudos

Hello, i'm facing the same issue while testing sample queries in the "Test your Agent" box. Could anyone plese help me with the process of enabling OBO authorization

  • 4 kudos
7 More Replies
Prashant_151
by • Databricks Partner
  • 4362 Views
  • 2 replies
  • 2 kudos

Resolved! Agent Bricks Cost and Billing

This is regarding agent bricks and want to understand DBU consumed while creating a knowledge assistant agent. Can anyone please share any video or documentation which will help me in this regard..Let's say I take a pdf on which we want Knowledge ass...

  • 4362 Views
  • 2 replies
  • 2 kudos
Latest Reply
Raman_Unifeye
Honored Contributor III
  • 2 kudos

As it is fairly new product and yet to be made availalbe in various region even in Public preview, we are running a webinar with Databricks SA. Below is the link to our earlier post. Pls feel free to join this and hear it directly from Databricks SA ...

  • 2 kudos
1 More Replies
kcailabs
by • New Contributor
  • 2144 Views
  • 1 replies
  • 1 kudos

Resolved! Running Into Erroneous "Databricks Connected" Messages with Claude Desktop

When I try to connect Databricks via the connector that is now available within Claude Desktop to a genie space I have available (which is just the default test one), Databricks appears to say that it connects successfully, but it never actually work...

kcailabs_1-1763354494688.png kcailabs_0-1763354486166.png
  • 2144 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @kcailabs , Thanks for sharing the screenshots—this helps. From what I can see, Claude shows a “Successfully connected to Databricks” toast while the Databricks connector still displays “Disconnected,” and the Server URL entered is just a p...

  • 1 kudos
DinoSaluzzi
by • New Contributor III
  • 12954 Views
  • 4 replies
  • 3 kudos

How to implement prompt caching using Claude models?

Hi, I am trying to use prompt caching future using claude "databricks-claude-sonnet-4" databricks endpoint (wrapped in a ChatDatabricks instance). Using langchain, I set  SystemMessage( content=[ { ...

Generative AI
ChatDatabricks
Prompt caching
  • 12954 Views
  • 4 replies
  • 3 kudos
Latest Reply
Pradeep54
Databricks Employee
  • 3 kudos

@DinoSaluzzi If you can restructure your system& user prompt in a similar manner to the examples provided, prompt caching should start working as expected. messages = [ { "role": "system", "content": [ { ...

  • 3 kudos
3 More Replies
SandipCoder
by • New Contributor II
  • 1705 Views
  • 1 replies
  • 1 kudos

Getting error while trying to use external MCP

I have created a mcp connection from marketplace :Conn Name : mcp_brightdata_web_surfermcp product url : https://brightdata.com/I have attached the mcp through playground . But while submitting the prompt I am getting the following error .Error : The...

  • 1705 Views
  • 1 replies
  • 1 kudos
Latest Reply
RahulPathakDBX
Databricks Employee
  • 1 kudos

Based on the error,  which is a "502 Bad Gateway" error indicates that a server sitting as a gateway or proxy received an invalid response from an upstream server. Here, Databricks is trying to communicate with the external MCP server associated with...

  • 1 kudos
Louis_Frolio
by • Databricks Employee
  • 2910 Views
  • 1 replies
  • 4 kudos

Why Agent Bricks Is a Game Changer

Check out Agent Bricks — Databricks’ new framework for building AI agents without writing a single line of code. Picture this: you describe your business challenge in plain English, point it at your data, and boom… a domain-specific agent comes to li...

  • 2910 Views
  • 1 replies
  • 4 kudos
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 4 kudos

Absolutely love the direction Databricks is heading with Agent Bricks — this is true innovation. Taking something as complex as building AI agents and turning it into a no-code, domain-aware, business-ready framework is a huge leap forward for teams ...

  • 4 kudos
Rjdudley
by • Honored Contributor
  • 2140 Views
  • 4 replies
  • 0 kudos

Add AI Guardrail results into response?

We're considering switching from Azure AI Foundry to Mosaic AI Gateway.  One nice feature AI Foundry has is it adds the content filter results to the response (and in a streaming response, each delta).  This allows us to provide some feedback to the ...

  • 2140 Views
  • 4 replies
  • 0 kudos
Latest Reply
CharlotteMarti2
New Contributor III
  • 0 kudos

To include AI Guardrail results in your responses, you need to enable logging or metadata propagation when the model generates output. Check if Mosaic AI Gateway supports attaching Guardrail flags or filter results as part of the response payload or ...

  • 0 kudos
3 More Replies
foubs
by • New Contributor II
  • 1271 Views
  • 3 replies
  • 0 kudos

Databrcks + sharepoint +Microsoft Teams Bot

I recently created a Teams Bot using Databricks Genie, and some of the data I want to retrieve from Databricks can be very large. The solution I am thinking of is for every bot request which will lead to lots of rows and columns to be retrieved, I wa...

  • 1271 Views
  • 3 replies
  • 0 kudos
Latest Reply
foubs
New Contributor II
  • 0 kudos

Hello @KaushalVachhani I was trying to find out if Databricks already has a template for this part "Genie Conversation API, saves it as a CSV file, and uploads it to SharePoint" Because the data might be big, eg more than 50 rows with more than four ...

  • 0 kudos
2 More Replies
Rjdudley
by • Honored Contributor
  • 1378 Views
  • 2 replies
  • 1 kudos

System tables for vector search index?

Are there system tables or log files for monitoring vector search index searches?  I didn't see vector search mentioned on the system tables documentation (Monitor account activity with system tables - Azure Databricks | Microsoft Learn).

  • 1378 Views
  • 2 replies
  • 1 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 1 kudos

Thanks @mark_ott are there plans to make the vector search a "proper" system table in Databricks rather than using an Azure Monitor table?

  • 1 kudos
1 More Replies
Darshan13
by • New Contributor
  • 1311 Views
  • 1 replies
  • 1 kudos

MLflow LangChain Model Serving Fails: _UNSUPPORTED_MODEL_ERROR_MESSAGE ImportError

I’m trying to log and serve a LangChain-based RFI chatbot model using MLflow in Databricks, but I’m encountering the following error when loading the model:ImportError: cannot import name '_UNSUPPORTED_MODEL_ERROR_MESSAGE' from 'mlflow.langchain.util...

  • 1311 Views
  • 1 replies
  • 1 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 1 kudos

@Darshan13 , Based on the error, It looks like when Databricks Model Serving tries to load your model, MLflow's internal code attempts to import _UNSUPPORTED_MODEL_ERROR_MESSAGE which doesn't exist in the LangChain utils structure. Are you successful...

  • 1 kudos
mcarreira
by • Databricks Partner
  • 5431 Views
  • 1 replies
  • 0 kudos

Add Azure Databricks tables as knowledge source into Copilot Studio Agent

Hello!I’m trying to add some tables from my Azure Databricks as a knowledge source in a Copilot Studio agent so that I can ask questions about the information stored in these tables.The connection is created successfully, and I can see a preview of m...

  • 5431 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

If your Azure Databricks tables show up as a knowledge source in Copilot Studio, but the agent cannot access data when you ask questions, the issue is often related to user or service account permissions, network rules, or the configuration of the ta...

  • 0 kudos
Labels