cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 30910 Views
  • 19 replies
  • 34 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 30910 Views
  • 19 replies
  • 34 kudos
Latest Reply
Poorva21
New Contributor II
  • 34 kudos

This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha 

  • 34 kudos
18 More Replies
smferro54epam
by New Contributor II
  • 398 Views
  • 1 replies
  • 0 kudos

Resolved! None of the Connect to the custom MCP server examples work

hi! I'm following through this documentation >> https://docs.databricks.com/aws/en/generative-ai/mcp/custom-mcp?language=Agent+code+%28service+principal%29 I have successfully deployed the app in Databricks and can use it from the playground and from...

  • 398 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @smferro54epam , the errors point to two distinct issues: your custom MCP app expects OAuth-based Databricks credentials (not a raw bearer token), and the URL you pass to the HTTP transport must be a fully qualified https URL to the app’s /...

  • 0 kudos
Maylin
by New Contributor
  • 4841 Views
  • 1 replies
  • 0 kudos

Best Practices for Multilingual Model Training: Single vs. Multi-Model for Translation

Hello everyone,I’m working on a translation project involving documents up to 100 pages long, in 17 different languages, and I'm looking for the best approach to achieve high-quality translations in this multilingual context.Single model vs. multi-mo...

  • 4841 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @Maylin ,  A single many-to-many multilingual model, fine-tuned jointly across your 17 languages, is usually the best trade-off between quality, scalability, and operational simplicity; combine it with lightweight adapters to preserve quali...

  • 0 kudos
MarsWalker
by New Contributor II
  • 4520 Views
  • 2 replies
  • 1 kudos

How to serve a RAG chain endpoint that supports streaming

Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...

  • 4520 Views
  • 2 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @MarsWalker ,  here’s how to get true streaming from a served RAG chain on Databricks Model Serving.   What’s going on The served endpoint error (“This endpoint does not support streaming”) is expected when the deployed entity doesn’t expos...

  • 1 kudos
1 More Replies
c4ndy
by New Contributor
  • 339 Views
  • 1 replies
  • 0 kudos

Provisioned Throughput is not supported for llama...

Hi,This question is tightly correlated with another discussion: Model deprecation issue while serving on Databrick... - Databricks Community - 131968In a nutshell, I'm trying to serve the model which is based on llama architecture (deployed through m...

  • 339 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @c4ndy ,  Thanks for sharing the context and links. I couldn’t read the Databricks Community thread from the URL you provided; please verify the URL and access settings, as it may not yet be available to Glean or require additional permissi...

  • 0 kudos
avadhut22111997
by New Contributor II
  • 4199 Views
  • 1 replies
  • 1 kudos

Request to share Genie space URL with restricted access

Dear Databricks Team,I hope this email finds you well.I would like to share a specific Genie Space URL with a user, but I want to ensure that the user only has access to view this particular Genie Space ask questions in that space and no other featur...

  • 4199 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @avadhut22111997 , sorry this fell through the cracks. I am Happy to help you lock down access to a single Genie Space so the user can only view it and ask questions there.   What “view and ask only” means in Genie Give the user the Genie S...

  • 1 kudos
tholers
by New Contributor II
  • 5057 Views
  • 1 replies
  • 2 kudos

Data security when using Databricks Foundation Model endpoints

Hi Databricks,My client is considering using Databricks as the solution to their RAG chatbot framework. We are testing on the Databrick's demo tutorial on its own documentation data (pdf files). The tutorial is provided at: 00-RAG-chatbot-Introductio...

  • 5057 Views
  • 1 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hey @tholers , here’s how Databricks handles data for the embedding model endpoints and what that means for tenant and data residency requirements. Short answer If you use Databricks-hosted embedding endpoints (for example, GTE-Large or BGE-Large), y...

  • 2 kudos
Khaja_Zaffer
by Contributor III
  • 343 Views
  • 3 replies
  • 1 kudos

GEN AI IN HEALTHCARE

Hello everyone !!Good day!Happy halloween I am just curious to know those who are working with GEN AI or related projects in healthcare. Is GEN AI buzz word finally became a common word or still there is scope in real world projects. How do you this ...

  • 343 Views
  • 3 replies
  • 1 kudos
Latest Reply
bianca_unifeye
Contributor
  • 1 kudos

Hi @Khaja_Zaffer ,Great question  and happy belated Halloween From what we’re seeing across clients in healthcare and life sciences, Generative AI has absolutely moved beyond the buzzword stage. It’s now being operationalised, but selectively, in are...

  • 1 kudos
2 More Replies
ankitmishra
by New Contributor
  • 239 Views
  • 1 replies
  • 0 kudos

Resolved! RAG pipeline in Databricks

We have to implement a RAG pipeline in Databricks using Unity Catalog and Delta tables, We are a databricks partner company, can we have some credits to do over this PoC

  • 239 Views
  • 1 replies
  • 0 kudos
Latest Reply
bianca_unifeye
Contributor
  • 0 kudos

Hi @ankitmishra,Yes, it is definitely possible to request credits for your PoC. The quickest route is to identify the Partner Solution Architect (PSA) assigned to your company account. They can submit the request on your behalf and even attach it to ...

  • 0 kudos
frankc
by New Contributor III
  • 1828 Views
  • 5 replies
  • 6 kudos

OpenAi gpt-oss support for responses API?

I was looking forward to using there openAI responses API when the new gpt-oss models were added to Databricks.The openAI website states these model are compatible with the responses API.However, it does not seem to support it on Databricks. See erro...

  • 1828 Views
  • 5 replies
  • 6 kudos
Latest Reply
CharlotteMarti2
New Contributor III
  • 6 kudos

That’s expected — Databricks’ current GPT-OSS integration only supports /completions and /chat/completions endpoints, not the /responses API yet. The OpenAI Responses API compatibility mentioned on OpenAI’s site applies to OpenAI-hosted models, not t...

  • 6 kudos
4 More Replies
smferro54epam
by New Contributor II
  • 607 Views
  • 4 replies
  • 2 kudos

Can't connect to custom MCP Server

I've tried connecting from local environment, notebook and following the sample notebook here:https://docs.databricks.com/aws/en/generative-ai/mcp/custom-mcp?language=Local+environmentAnd I'm always getting the same error:httpx.ConnectError: All conn...

  • 607 Views
  • 4 replies
  • 2 kudos
Latest Reply
smferro54epam
New Contributor II
  • 2 kudos

I wasn't setting the MCP server as a streamable http, I've done that already and it works!

  • 2 kudos
3 More Replies
old_school
by New Contributor II
  • 458 Views
  • 1 replies
  • 1 kudos

Resolved! Error in output of databricks managed mcp server

Hi Databricks Community,Need suggestions.I have added two functions and I am able to use them. I am using Cursor IDE but in the logs I can see below error,2025-11-01 20:10:23.203 [info] Handling CreateClient action2025-11-01 20:10:23.203 [info] Creat...

  • 458 Views
  • 1 replies
  • 1 kudos
Latest Reply
AbhaySingh
Databricks Employee
  • 1 kudos

The most important thing to know is: Databricks supports external MCP servers only if they use the Streamable HTTP transport mechanism. Client errors related to Streamable HTTP typically occur if the MCP server or client is not compliant with this tr...

  • 1 kudos
manoctch
by New Contributor
  • 242 Views
  • 1 replies
  • 0 kudos

Playground doesn't show tool results

Hii,I’ve created a model in Databricks that uses different tools. One of these tools generates a chart based on data read from Genie.I’d like to visualize this chart (basically an image) in Playground, but so far I haven’t found a way to do it. At th...

  • 242 Views
  • 1 replies
  • 0 kudos
Latest Reply
AbhaySingh
Databricks Employee
  • 0 kudos

  The Issue:   Databricks Playground typically has limited native support for rendering base64 images   directly in the chat interface. This is a known limitation in many AI playground   environments.     Potential Workarounds:     1. Use Markdown Im...

  • 0 kudos
KrzysztofPrzyso
by New Contributor III
  • 4845 Views
  • 1 replies
  • 1 kudos

Accessing UC Volumes using pure python (ML) with databricks-connect

Hi All,In my organization, we use Databricks Connect and VS Code for data engineering purposes. This setup is working great, especially for:- Debugging- Unit tests- GitHub Copilot- Reusable modules and custom librariesIn my view, the developer experi...

  • 4845 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hey @KrzysztofPrzyso , so sorry this question got lost in the shuffle. This is a known architectural limitation with Databricks Connect when working with pure Python file operations and UC Volumes. The issue stems from how Databricks Connect executes...

  • 1 kudos
jAAmes_bentley
by Contributor
  • 4107 Views
  • 1 replies
  • 1 kudos

AI_QUERY fails with o1-mini

As of sometime between March 7th and March 12, the AI_QUERY function has become very temperamental with Azure OpenAI models.Asking a basic question of our Mosaic AI o1-mini serving endpoint using AI_QUERY causes an error sometimes but not every time:...

jAAmes_bentley_0-1741797431261.png
  • 4107 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hello @jAAmes_bentley , I did some digging and here is what I found. Root Cause: Unsupported Temperature Parameter The primary issue with your `AI_QUERY` call to o1-mini is the temperature parameter. OpenAI's o1-series models (o1, o1-mini, o1-preview...

  • 1 kudos
Ajay-Pandey
by Databricks MVP
  • 338 Views
  • 2 replies
  • 0 kudos

Issue while implementation of Use Genie in multi-agent systems

I am testing https://docs.databricks.com/aws/en/generative-ai/agent-framework/multi-agent-genie and looks code is not up to date and it is failing as longchain version upgraded to v1 from v0 that does not support post_model_hook parameter.I tried mul...

  • 338 Views
  • 2 replies
  • 0 kudos
Latest Reply
Harris234
New Contributor II
  • 0 kudos

Hi Ajay, it looks like the Databricks multi-agent Genie docs haven’t been updated for langchain v1. You’ll need to remove or replace the post_model_hook parameter with the new callback or event handling mechanisms in v1. Checking the latest langchain...

  • 0 kudos
1 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now