cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 33186 Views
  • 22 replies
  • 46 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 33186 Views
  • 22 replies
  • 46 kudos
Latest Reply
Darshan137
New Contributor II
  • 46 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 46 kudos
21 More Replies
Suheb
by Contributor
  • 1258 Views
  • 1 replies
  • 1 kudos

Resolved! How do I build a robust multi-agent system (e.g. using Agent Bricks / Genie) on Databricks, while en

How can I set up several AI agents on Databricks that work together at the same time, and make sure they don’t mess up the data or break the system?

  • 1258 Views
  • 1 replies
  • 1 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 1 kudos

@Suheb, Depends on your usecase. However, if it fits, I would recommend that you start with a multi-agent supervisor if you have the agents from the list below An existing Agent Bricks: Knowledge Assistant(/generative-ai/agent-bricks/knowledge-assist...

  • 1 kudos
snarayan
by New Contributor III
  • 682 Views
  • 3 replies
  • 4 kudos

Multi‑Agent Supervisor: url_citation (source links) not shown in Playground — why and how to enable?

I’m seeing a difference in citation behavior between a single Knowledge Assistant (KA) agent and the Multi‑Agent Supervisor setup.What I testedIn Agent Bricks → Knowledge Assistant, I created an agent that returns citations with links (e.g., url_cita...

  • 682 Views
  • 3 replies
  • 4 kudos
Latest Reply
Hubert-Dudek
Databricks MVP
  • 4 kudos

@snarayan great feedback what should be improved!

  • 4 kudos
2 More Replies
snarayan
by New Contributor III
  • 2102 Views
  • 2 replies
  • 2 kudos

How to Increase HTTP Request Timeout for Databricks App Beyond 120 Seconds?

I’ve built a Databricks App using Gradio that leverages predict_stream to get streaming responses from a multi-agent supervisor. The app coordinates reasoning across four knowledge agents, so the model uses a long chain-of-thought process before retu...

  • 2102 Views
  • 2 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Hi @snarayan ,I think you might be hitting timeout from model serving endpoint:Debug model serving timeouts - Azure Databricks | Microsoft LearnYou can try to increase timeout using environment variables using the Serving UI or programmatically using...

  • 2 kudos
1 More Replies
maikel
by Contributor II
  • 1525 Views
  • 9 replies
  • 2 kudos

Resolved! Custom MCP deployment

Hi Community!I have a question - could somebody please guide me how to deploy my custom MCP server to databricks?What I would like to achieve is the following:I have a unity catalog in databricks for which I would like to have MCPif the data in unity...

  • 1525 Views
  • 9 replies
  • 2 kudos
Latest Reply
maikel
Contributor II
  • 2 kudos

@Hubert-Dudek ! Okay, I did not know about it! Unfortunately in my databricks workspace a can see Agent Bricks as Coming Soon  

  • 2 kudos
8 More Replies
Shivani_Pande
by New Contributor III
  • 1051 Views
  • 3 replies
  • 3 kudos

Resolved! Serving model issue in databricks

I’m facing an issue while trying to deploy a custom pyfunc model for Qwen3-Embedding-8B (GGUF format) registered in Unity Catalog. The GGUF model file is stored inside a Unity Catalog Volume, and during model training and registration everything work...

  • 1051 Views
  • 3 replies
  • 3 kudos
Latest Reply
Shivani_Pande
New Contributor III
  • 3 kudos

Thank you so much. That solved my problem

  • 3 kudos
2 More Replies
Prashanthkumar
by New Contributor III
  • 2258 Views
  • 5 replies
  • 2 kudos

Resolved! Databricks Genie new space creation using API

I am exploring an option to see if Databricks Genie can be created using API or using python script?

  • 2258 Views
  • 5 replies
  • 2 kudos
Latest Reply
mcassis15
Databricks Employee
  • 2 kudos

A recent update introduced the ability to create, update, and delete genie spaces. By stringing these together into your CI/CD pipeline, you should be able to accomplish everything you need. It is not in the SDK or DABs quite yet, but keep an eye out...

  • 2 kudos
4 More Replies
Suheb
by Contributor
  • 591 Views
  • 3 replies
  • 1 kudos

What is the core goal of your project or what problem are you trying to solve with generative AI or

What problem are you trying to solve using Databricks and generative AI?

  • 591 Views
  • 3 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

Below are high-impact problems you can solve with Databricks and generative AI, grounded in your enterprise data and governed end to end. Customer and employee knowledge accessBuild RAG-powered knowledge assistants that answer questions over your pr...

  • 1 kudos
2 More Replies
shivamrai162
by New Contributor III
  • 841 Views
  • 3 replies
  • 2 kudos

Resolved! Multi Agent Supervisor not able to coordinate with genie when deployed as a databricks app

Hello,I've provided necessary permissions to a chatbot that i created using DAB and deployed on databricks apps following this documentation. At the backend its using below agentsMulti Agent SupervisorKnowledge AssistantAI/BI GenieI've provided can_q...

shivamrai162_0-1764239231427.png
  • 841 Views
  • 3 replies
  • 2 kudos
Latest Reply
shivamrai162
New Contributor III
  • 2 kudos

Hello Bianca,After following what you told, i found issues at two levelsOne was the missing genie-space configuration within databricks.ymlOther was with granting permissions to the service principal (app identity) access to the underlying tables.tha...

  • 2 kudos
2 More Replies
rafaelgildin
by New Contributor II
  • 1729 Views
  • 3 replies
  • 1 kudos

Error from mlflow traces in Databricks notebook

I'm unable to log my traces in my mlflow experiments.The goal is to have the tracing from my genAI calls like described in Tutorial: Connect your development environment to MLflow .So I'm able to create my experiment run, but they are every time empt...

rafaelgildin_0-1764261207256.png
  • 1729 Views
  • 3 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

@rafaelgildin , I see that you have raised an Issue in the OSS mlflow repo, while the issue that you are encountering is on Databricks. The issue here is that you are explicitly adding trace.set_tracer_provider(tracer_provider). Databricks installs i...

  • 1 kudos
2 More Replies
Rahul-vlk
by New Contributor
  • 1323 Views
  • 1 replies
  • 1 kudos

model-specific tools (code interpreters, search, etc.) for OpenAI / Anthropic / Google

Hi,I’m happy to see that the latest models from the three major AI labs (OpenAI, Anthropic, and Google) are now available on Databricks. I had a follow-up question about what exactly is supported.Is Databricks only exposing the base models, or are so...

  • 1323 Views
  • 1 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

Hi @Rahul-vlk  You can use the models both as Databricks-hosted “first‑party” endpoints and via “external model” endpoints that proxy to the provider’s hosted APIs, all through a unified, OpenAI‑compatible interface for chat, embeddings, vision, and ...

  • 1 kudos
snarayan
by New Contributor III
  • 606 Views
  • 1 replies
  • 1 kudos

Resolved! Lakesense Auth Error When Creating Multiple Knowledge Assistant Agents in Databricks

I’m encountering an issue related to Lakesense authentication when working with Agent Bricks Knowledge Assistant (KA) agents (I recreated thisAgent Bricks Knowledge Assistant agent), and I haven’t found any documentation on this. Hoping someone here ...

Generative AI
Agent Bricks
  • 606 Views
  • 1 replies
  • 1 kudos
Latest Reply
snarayan
New Contributor III
  • 1 kudos

Update: The new agents I create are now working as expected. A Databricks architect suggested that the earlier issue might have been due to a backend outage, since customers typically shouldn’t encounter Lakesense errors. At this point, any newly cre...

  • 1 kudos
Suheb
by Contributor
  • 930 Views
  • 1 replies
  • 0 kudos

How do I build a retrieval-augmented generation (RAG) pipeline on Databricks — what are the best pra

How can I build an AI system (using Databricks) where the AI model doesn’t just rely on its built-in knowledge, but also retrieves real information from a database or documents before answering?

  • 930 Views
  • 1 replies
  • 0 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 0 kudos

@Suheb , We have a bunch of resources around Databricks RAG. Did you have a chance to look at the available documentation? Adding a few of them below. Databricks docs for RAG: https://docs.databricks.com/aws/en/generative-ai/retrieval-augmented-gener...

  • 0 kudos
Rajat-TVSM
by New Contributor III
  • 476 Views
  • 2 replies
  • 1 kudos

Random/Rare Bad Request error with Agent Serving endpoint

Whats the reason behind receiving below error at some rare occassions (once in a month)?"error_code": "BAD_REQUEST", "message": "Encountered an unexpected error while evaluating the model. Verify that the input is compatible with the model for infere...

  • 476 Views
  • 2 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

@Rajat-TVSM  That message is the generic model-serving “bad request” wrapper we return when a predict operation fails or the request doesn’t match the model’s expected input. The quickest way forward is to validate your payload against the model sign...

  • 1 kudos
1 More Replies
old_school
by New Contributor II
  • 594 Views
  • 3 replies
  • 2 kudos

Tags are not getting propagated immediately to Genie space for filtering Data Assets

Hi Databricks Team,I have created a Table and added a tag to it but i couldn't see that tag immediately in the Genie Space for filtering. It seems to be an issue of eventual consistency. I added a tag to a table and it seems to take 2 days to reflect...

  • 594 Views
  • 3 replies
  • 2 kudos
Latest Reply
old_school
New Contributor II
  • 2 kudos

Hi @Louis_Frolio ,Thanks for your inputs.Is there a way to add tables / views via SDK / API to Genie spaces?

  • 2 kudos
2 More Replies
stephs
by New Contributor
  • 561 Views
  • 1 replies
  • 1 kudos

agent bricks - can't figure out how to enable Knowledge Assistant

Hi, getting this error when trying to build a Knowledge Assistant agent: I have a premium account in the eastus region. The docs say I need to have a 'serverless budget policy' configured, but despite all my attempts, i can't get it to show up as an ...

stephs_0-1763743451769.png
  • 561 Views
  • 1 replies
  • 1 kudos
Latest Reply
Thompson2345
New Contributor III
  • 1 kudos

Hi Steph, it sounds like the Knowledge Assistant requires a serverless budget policy linked to your premium account. If it’s not showing in admin settings, it’s often a region/configuration issue. I’d recommend:Double-check that your East US account ...

  • 1 kudos