cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 35173 Views
  • 22 replies
  • 47 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 35173 Views
  • 22 replies
  • 47 kudos
Latest Reply
Darshan137
New Contributor II
  • 47 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 47 kudos
21 More Replies
stexil
by New Contributor
  • 1249 Views
  • 2 replies
  • 0 kudos

Utilizing Genie AI with Workflows

As subject says, is this possible via creating a python script that calls agent.predict etc...? Similar to thisagent.predict( { "messages": [{"role": "user", "content": "...the question we want to ask Genie..."}], } )I want to implement Genie AI, and...

  • 1249 Views
  • 2 replies
  • 0 kudos
Latest Reply
dkushari
Databricks Employee
  • 0 kudos

Hi @stexil, you can achieve this by using Genie as an agent in a multi-agent system. If you prefer to use code then follow this - https://docs.databricks.com/aws/en/generative-ai/agent-framework/multi-agent-genie#gsc.tab=0. If you want to use point a...

  • 0 kudos
1 More Replies
JingXie
by Databricks Partner
  • 4014 Views
  • 2 replies
  • 2 kudos

Resolved! Model serving endpoint API error - Mosaic AI Agents API

Hi, I have built a Chatbot App using Streamlit (through Databricks Apps UI). The chatbot backend is a custom RAG model which is built by following this example notebook: 02-Deploy-RAG-Chatbot-Model.The needed databricks packages are installed: databr...

  • 4014 Views
  • 2 replies
  • 2 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 2 kudos

Hi @JingXie, This is a classic authentication token issue, but it's happening in a different place than you might think. The Invalid Token error is not coming from your Streamlit App's call to your chatbot_poc endpoint. It's coming from inside your c...

  • 2 kudos
1 More Replies
Prashanthkumar
by New Contributor III
  • 3728 Views
  • 3 replies
  • 2 kudos

Resolved! Whether Databricks has any plans to Integrate Databricks Genie with Azure OpenAI?

Hi,I am checking to see if Databricks has any plans to Integrate Databricks Genie with Azure OpenAI? as I know Databricks Genie is designed to work with Databricks' data ecosystem itself. But is there any plans to enhance this capability where we can...

  • 3728 Views
  • 3 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

@Prashanthkumar , if you are satisfied with my response would you mind clicking on "Accept as Solution" so that others will have confidence in the answer. Thanks, Louis.

  • 2 kudos
2 More Replies
brahaman
by New Contributor II
  • 868 Views
  • 2 replies
  • 1 kudos

Agent Serving Not Able To Use Route Optimisation

Hey y'all !I have model that I already serve with `agents.deploy` and works fine.I wanted to try out the Route Optimisation features as it can be found in the Edit tab of a model serving by adding in the creation via the API call (https://docs.databr...

  • 868 Views
  • 2 replies
  • 1 kudos
Latest Reply
MandyR
Community Manager
  • 1 kudos

@brahaman If this has solved your issue, please click the Accept as Solution button. Thanks! 

  • 1 kudos
1 More Replies
mmoise
by New Contributor II
  • 1136 Views
  • 1 replies
  • 0 kudos

Resolved! Cannot create databricks app using knowledge assistant

Hello, I built a knowledge assistant and I want to create a databricks app with it. I am using the streamlit chatbot template. I get an error "endpoint not supported". I can successfully create other databricks apps using models like claude sonnet. I...

  • 1136 Views
  • 1 replies
  • 0 kudos
Latest Reply
dkushari
Databricks Employee
  • 0 kudos

Hi @mmoise - It is not yet possible to create a DB app using an agent created from Agent Bricks KA. It will be added soon in the future. You can create a custom app, though. You can refer to the DB apps cookbook and use FastAPI as backend and React a...

  • 0 kudos
suho_ryo
by New Contributor III
  • 1101 Views
  • 4 replies
  • 0 kudos

Agent Bricks import table error

"I encountered an error when I tried to import a table to improve the quality of the Agent Bricks Knowledge Assistant. The error message is: 'Unrecognized token 'The': was expecting ('true', 'false' or 'null') at [Source: The provided text discusses ...

  • 1101 Views
  • 4 replies
  • 0 kudos
Latest Reply
suho_ryo
New Contributor III
  • 0 kudos

Hello @Khaja_Zaffer Here is the actual data I tried to import:INSERT INTO table_name VALUES ( 'eval-001', 'Translate this text to Japanese.', array('Be natural.', 'Keep the original nuance.'), array('true', 'false'), '{"model_version": "Kno...

  • 0 kudos
3 More Replies
actualhuman_012
by New Contributor III
  • 1425 Views
  • 3 replies
  • 4 kudos

Resolved! Facing pydantic errors at runtime in MLFlow ChatAgent

Code works fine locally but deployment in serving endpoint gives me below error at runtime:{"error_code": "BAD_REQUEST", "message": "Encountered an unexpected error while evaluating the model. Verify that the input is compatible with the model for in...

  • 1425 Views
  • 3 replies
  • 4 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 4 kudos

Hi @actualhuman_012 ,Below someone had the exact same issue. The solution is to use newer version of mlflow >= 3.2The problem is caused because there's been an update in pydantic. They changed a lot of things in pydantic v2. So not all APIs are compa...

  • 4 kudos
2 More Replies
Yash01Kumar12
by Databricks Partner
  • 2182 Views
  • 5 replies
  • 2 kudos

Resolved! Select LLM in Agentbricks - Knowledge Assistant

Hello,I am preparing a demo using for Multi Agent Supervisor Agent using knowledge assistant and Genie. Throughout the demo creation I have the following doubts:1) In the Knowledge assistant can we select another LLM model. Also, by default which LLM...

  • 2182 Views
  • 5 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

A bit more information: In Agent Bricks, Databricks “automatically try various AI models, fine‑tune them using your data, optimize, and evaluate” to pick the best system for your use case — model selection is managed by the backend rather than the KA...

  • 2 kudos
4 More Replies
suho_ryo
by New Contributor III
  • 1013 Views
  • 2 replies
  • 1 kudos

Resolved! Where is the vector table created by the Knowledge Assistant located?

In Agent Bricks' Knowledge Assistant, you can create a chatbot using files on Unity Catalog. I suspect that a vector table is being created from these files. If so, where would this vector table be located? It doesn't seem to be present in my own Uni...

  • 1013 Views
  • 2 replies
  • 1 kudos
Latest Reply
suho_ryo
New Contributor III
  • 1 kudos

Hi @szymon_dybczak ,Thank you for your reply. I assume it's located on the Databricks serverless side.

  • 1 kudos
1 More Replies
Yash01Kumar12
by Databricks Partner
  • 1350 Views
  • 3 replies
  • 0 kudos

Agent Bricks Information Extraction

I am facing some problem in Information extraction using PDF. I have done all the necessary steps. 1) I loaded the data in Volume.2) I ran the Use PDF's functionality to create a structure table of the PDFs3) I now have the table with the column name...

Yash01Kumar12_0-1760117409670.png Yash01Kumar12_1-1760117530018.png
  • 1350 Views
  • 3 replies
  • 0 kudos
Latest Reply
Yash01Kumar12
Databricks Partner
  • 0 kudos

Thank You @NandiniN for responding. For now, I have changed the type of "raw_parsed" to string and created a vector index after that.But can you help me with one more thing. I am creating a Multi-Agent-Supervisor, can you explain me the need of OBO U...

  • 0 kudos
2 More Replies
JohnnyA
by New Contributor II
  • 3234 Views
  • 2 replies
  • 2 kudos

Resolved! Using Genie Conversational API with External Users and Data-Level Security

We are planning to implement a chat interface in our portal application using the Genie Conversational API, where clients, partners, and internal users can ask questions in natural language and receive answers based on our data.I have the following q...

  • 3234 Views
  • 2 replies
  • 2 kudos
Latest Reply
Isi
Honored Contributor III
  • 2 kudos

Hello @JohnnyA I'll try to explain ideas and hope something works for you because I don't have the whole context.1) Authentication & authorization for external usersRecommended (best practice):Federated identity + OBO. Your portal authenticates with ...

  • 2 kudos
1 More Replies
ChrisLawford_n1
by Contributor II
  • 2382 Views
  • 2 replies
  • 0 kudos

Resolved! Clarification on Databricks Claude 3.7 Sonnet native serving endpoint data processing location.

Hello, I am trying to clarify if Databricks Claude 3.7 Native serving endpoint is safe for use in our enterprise or if it needs to be disabled.I am trying to understand if the data sent to this endpoint is kept within our geo region (UKSouth/Europe)....

ChrisLawford_n1_0-1753277934139.png
  • 2382 Views
  • 2 replies
  • 0 kudos
Latest Reply
Krishna_S
Databricks Employee
  • 0 kudos

Hi @ChrisLawford_n1  The Databricks Claude 3.7 for UKsouth, as you can see in the documentation, can only be used if it is supported based on GPU availability and requires cross-geo routing to be enabled, so cross-geo processing that allows data for ...

  • 0 kudos
1 More Replies
Dulce42
by New Contributor II
  • 6922 Views
  • 1 replies
  • 1 kudos

Resolved! API GENIE

Hi community!Yesterday I tried extract history chat from my genie spaces but I can't export chats from other users, I have the next error:{'error_code': 'PERMISSION_DENIED', 'message': 'User XXXXXXXX does not own conversation XXXXXXXX', 'details': [{...

  • 6922 Views
  • 1 replies
  • 1 kudos
Latest Reply
mark_ott
Databricks Employee
  • 1 kudos

Based on current documentation and available resources, exporting chat histories from Genie Spaces is restricted by ownership rules: only the user who owns the conversation can export that specific chat history, regardless of admin permissions or wor...

  • 1 kudos
PiotrM
by New Contributor III
  • 3608 Views
  • 7 replies
  • 10 kudos

Resolved! ai_query not affected by AI gateway's rate limits?

Hey, We've been testing the ai_query (Azure Databricks here) on preconfigured model serving endpoints likedatabricks-meta-llama-3-3-70b-instruct and the initial results look nice. I'm trying to limit the number of requests that could be sent to those...

  • 3608 Views
  • 7 replies
  • 10 kudos
Latest Reply
PiotrM
New Contributor III
  • 10 kudos

Hey, @BS_THE_ANALYST, before writing that post, I went exactly through the docs you've posted. I wasn't able to find a specific confirmation (or denial) that this function will be affected by the rate limits, which led me to believe that it's worth a...

  • 10 kudos
6 More Replies
qlmahga2
by New Contributor III
  • 1911 Views
  • 2 replies
  • 1 kudos

Finally fix Claude Opus

It's been almost 3 months since the announcement of First-party Anthropic Claude Opus 4 on Databricks Mosaic AI Model Serving, but the model is still unavailable.It's listed in the pricing and documentation, but on the Serving endpoints page, it's be...

  • 1911 Views
  • 2 replies
  • 1 kudos
Latest Reply
jack_zaldivar
Databricks Employee
  • 1 kudos

Hi @qlmahga2 , it appears that Claude Sonnet 4 and Claude Sonnet 4.5 are both currently available. I'm not sure what it looked like when you asked this question, as I didn't check at that time. However, it looks like they should be available now. Can...

  • 1 kudos
1 More Replies