cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 31398 Views
  • 19 replies
  • 38 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 31398 Views
  • 19 replies
  • 38 kudos
Latest Reply
Poorva21
New Contributor III
  • 38 kudos

This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha 

  • 38 kudos
18 More Replies
SandipCoder
by New Contributor II
  • 4399 Views
  • 1 replies
  • 0 kudos

Issue with Multi agent supervisor based agentic framework

I  have three agents in my multi agent framework (code attached) Supervisor : This is the main controller    "Genie":           #this is a genai agent    "Coder":          #this is a re-act agent created on the fly    "Weather":      #this is an exis...

  • 4399 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

Your multi-agent framework has several issues affecting agent iteration control and error handling. Here’s a lined explanation and practical suggestions for each problem: Agents not stopping at one iteration Agents consistently reaching the max iter...

  • 0 kudos
MattB
by New Contributor III
  • 4592 Views
  • 1 replies
  • 0 kudos

AI/BI Genie - Components

I am almost certain that AI/BI Genie is using Azure OpenAi under the hood. Does anyone knows if Langchain has been used too ?

  • 4592 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

AI/BI Genie is confirmed to use Azure OpenAI under the hood, as it leverages generative AI models for translating natural language into analytical queries and producing business intelligence insights. Additionally, there is strong evidence that Langc...

  • 0 kudos
Ulfzerk
by New Contributor
  • 4495 Views
  • 1 replies
  • 1 kudos

Custom sentence transformer for indexing

Hi! i would like to use my own sentence transformer to create a vector index. It is not a problem using mlflow sentence-transformer flavour, it works fine with: mlflow.sentence_transformers.log_model( model, artifact_path="model", signatu...

  • 4495 Views
  • 1 replies
  • 1 kudos
Latest Reply
mark_ott
Databricks Employee
  • 1 kudos

To use a custom MLflow pyfunc model for sentence-transformers with preprocessing, you need to comply with the expected interface of mlflow.pyfunc.PythonModel, especially the predict method. The method signature, data handling, and serialization are k...

  • 1 kudos
smferro54epam
by New Contributor II
  • 730 Views
  • 1 replies
  • 0 kudos

Resolved! None of the Connect to the custom MCP server examples work

hi! I'm following through this documentation >> https://docs.databricks.com/aws/en/generative-ai/mcp/custom-mcp?language=Agent+code+%28service+principal%29 I have successfully deployed the app in Databricks and can use it from the playground and from...

  • 730 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @smferro54epam , the errors point to two distinct issues: your custom MCP app expects OAuth-based Databricks credentials (not a raw bearer token), and the URL you pass to the HTTP transport must be a fully qualified https URL to the app’s /...

  • 0 kudos
Maylin
by New Contributor
  • 5310 Views
  • 1 replies
  • 0 kudos

Best Practices for Multilingual Model Training: Single vs. Multi-Model for Translation

Hello everyone,I’m working on a translation project involving documents up to 100 pages long, in 17 different languages, and I'm looking for the best approach to achieve high-quality translations in this multilingual context.Single model vs. multi-mo...

  • 5310 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @Maylin ,  A single many-to-many multilingual model, fine-tuned jointly across your 17 languages, is usually the best trade-off between quality, scalability, and operational simplicity; combine it with lightweight adapters to preserve quali...

  • 0 kudos
MarsWalker
by New Contributor II
  • 5026 Views
  • 2 replies
  • 1 kudos

How to serve a RAG chain endpoint that supports streaming

Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...

  • 5026 Views
  • 2 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @MarsWalker ,  here’s how to get true streaming from a served RAG chain on Databricks Model Serving.   What’s going on The served endpoint error (“This endpoint does not support streaming”) is expected when the deployed entity doesn’t expos...

  • 1 kudos
1 More Replies
c4ndy
by New Contributor
  • 451 Views
  • 1 replies
  • 0 kudos

Provisioned Throughput is not supported for llama...

Hi,This question is tightly correlated with another discussion: Model deprecation issue while serving on Databrick... - Databricks Community - 131968In a nutshell, I'm trying to serve the model which is based on llama architecture (deployed through m...

  • 451 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @c4ndy ,  Thanks for sharing the context and links. I couldn’t read the Databricks Community thread from the URL you provided; please verify the URL and access settings, as it may not yet be available to Glean or require additional permissi...

  • 0 kudos
avadhut22111997
by New Contributor II
  • 4607 Views
  • 1 replies
  • 1 kudos

Request to share Genie space URL with restricted access

Dear Databricks Team,I hope this email finds you well.I would like to share a specific Genie Space URL with a user, but I want to ensure that the user only has access to view this particular Genie Space ask questions in that space and no other featur...

  • 4607 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @avadhut22111997 , sorry this fell through the cracks. I am Happy to help you lock down access to a single Genie Space so the user can only view it and ask questions there.   What “view and ask only” means in Genie Give the user the Genie S...

  • 1 kudos
tholers
by New Contributor II
  • 5734 Views
  • 1 replies
  • 2 kudos

Data security when using Databricks Foundation Model endpoints

Hi Databricks,My client is considering using Databricks as the solution to their RAG chatbot framework. We are testing on the Databrick's demo tutorial on its own documentation data (pdf files). The tutorial is provided at: 00-RAG-chatbot-Introductio...

  • 5734 Views
  • 1 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hey @tholers , here’s how Databricks handles data for the embedding model endpoints and what that means for tenant and data residency requirements. Short answer If you use Databricks-hosted embedding endpoints (for example, GTE-Large or BGE-Large), y...

  • 2 kudos
Khaja_Zaffer
by Esteemed Contributor
  • 422 Views
  • 3 replies
  • 1 kudos

GEN AI IN HEALTHCARE

Hello everyone !!Good day!Happy halloween I am just curious to know those who are working with GEN AI or related projects in healthcare. Is GEN AI buzz word finally became a common word or still there is scope in real world projects. How do you this ...

  • 422 Views
  • 3 replies
  • 1 kudos
Latest Reply
bianca_unifeye
Contributor
  • 1 kudos

Hi @Khaja_Zaffer ,Great question  and happy belated Halloween From what we’re seeing across clients in healthcare and life sciences, Generative AI has absolutely moved beyond the buzzword stage. It’s now being operationalised, but selectively, in are...

  • 1 kudos
2 More Replies
ankitmishra
by New Contributor
  • 296 Views
  • 1 replies
  • 0 kudos

Resolved! RAG pipeline in Databricks

We have to implement a RAG pipeline in Databricks using Unity Catalog and Delta tables, We are a databricks partner company, can we have some credits to do over this PoC

  • 296 Views
  • 1 replies
  • 0 kudos
Latest Reply
bianca_unifeye
Contributor
  • 0 kudos

Hi @ankitmishra,Yes, it is definitely possible to request credits for your PoC. The quickest route is to identify the Partner Solution Architect (PSA) assigned to your company account. They can submit the request on your behalf and even attach it to ...

  • 0 kudos
frankc
by New Contributor III
  • 2606 Views
  • 5 replies
  • 6 kudos

OpenAi gpt-oss support for responses API?

I was looking forward to using there openAI responses API when the new gpt-oss models were added to Databricks.The openAI website states these model are compatible with the responses API.However, it does not seem to support it on Databricks. See erro...

  • 2606 Views
  • 5 replies
  • 6 kudos
Latest Reply
CharlotteMarti2
New Contributor III
  • 6 kudos

That’s expected — Databricks’ current GPT-OSS integration only supports /completions and /chat/completions endpoints, not the /responses API yet. The OpenAI Responses API compatibility mentioned on OpenAI’s site applies to OpenAI-hosted models, not t...

  • 6 kudos
4 More Replies
smferro54epam
by New Contributor II
  • 697 Views
  • 4 replies
  • 2 kudos

Can't connect to custom MCP Server

I've tried connecting from local environment, notebook and following the sample notebook here:https://docs.databricks.com/aws/en/generative-ai/mcp/custom-mcp?language=Local+environmentAnd I'm always getting the same error:httpx.ConnectError: All conn...

  • 697 Views
  • 4 replies
  • 2 kudos
Latest Reply
smferro54epam
New Contributor II
  • 2 kudos

I wasn't setting the MCP server as a streamable http, I've done that already and it works!

  • 2 kudos
3 More Replies
old_school
by New Contributor II
  • 615 Views
  • 1 replies
  • 1 kudos

Resolved! Error in output of databricks managed mcp server

Hi Databricks Community,Need suggestions.I have added two functions and I am able to use them. I am using Cursor IDE but in the logs I can see below error,2025-11-01 20:10:23.203 [info] Handling CreateClient action2025-11-01 20:10:23.203 [info] Creat...

  • 615 Views
  • 1 replies
  • 1 kudos
Latest Reply
AbhaySingh
Databricks Employee
  • 1 kudos

The most important thing to know is: Databricks supports external MCP servers only if they use the Streamable HTTP transport mechanism. Client errors related to Streamable HTTP typically occur if the MCP server or client is not compliant with this tr...

  • 1 kudos
manoctch
by New Contributor
  • 297 Views
  • 1 replies
  • 0 kudos

Playground doesn't show tool results

Hii,I’ve created a model in Databricks that uses different tools. One of these tools generates a chart based on data read from Genie.I’d like to visualize this chart (basically an image) in Playground, but so far I haven’t found a way to do it. At th...

  • 297 Views
  • 1 replies
  • 0 kudos
Latest Reply
AbhaySingh
Databricks Employee
  • 0 kudos

  The Issue:   Databricks Playground typically has limited native support for rendering base64 images   directly in the chat interface. This is a known limitation in many AI playground   environments.     Potential Workarounds:     1. Use Markdown Im...

  • 0 kudos