cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 30798 Views
  • 19 replies
  • 34 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 30798 Views
  • 19 replies
  • 34 kudos
Latest Reply
Poorva21
New Contributor II
  • 34 kudos

This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha 

  • 34 kudos
18 More Replies
MarsWalker
by New Contributor II
  • 4394 Views
  • 2 replies
  • 1 kudos

How to serve a RAG chain endpoint that supports streaming

Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...

  • 4394 Views
  • 2 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @MarsWalker ,  here’s how to get true streaming from a served RAG chain on Databricks Model Serving.   What’s going on The served endpoint error (“This endpoint does not support streaming”) is expected when the deployed entity doesn’t expos...

  • 1 kudos
1 More Replies
c4ndy
by New Contributor
  • 323 Views
  • 1 replies
  • 0 kudos

Provisioned Throughput is not supported for llama...

Hi,This question is tightly correlated with another discussion: Model deprecation issue while serving on Databrick... - Databricks Community - 131968In a nutshell, I'm trying to serve the model which is based on llama architecture (deployed through m...

  • 323 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @c4ndy ,  Thanks for sharing the context and links. I couldn’t read the Databricks Community thread from the URL you provided; please verify the URL and access settings, as it may not yet be available to Glean or require additional permissi...

  • 0 kudos
avadhut22111997
by New Contributor II
  • 4123 Views
  • 1 replies
  • 1 kudos

Request to share Genie space URL with restricted access

Dear Databricks Team,I hope this email finds you well.I would like to share a specific Genie Space URL with a user, but I want to ensure that the user only has access to view this particular Genie Space ask questions in that space and no other featur...

  • 4123 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @avadhut22111997 , sorry this fell through the cracks. I am Happy to help you lock down access to a single Genie Space so the user can only view it and ask questions there.   What “view and ask only” means in Genie Give the user the Genie S...

  • 1 kudos
tholers
by New Contributor II
  • 4947 Views
  • 1 replies
  • 2 kudos

Data security when using Databricks Foundation Model endpoints

Hi Databricks,My client is considering using Databricks as the solution to their RAG chatbot framework. We are testing on the Databrick's demo tutorial on its own documentation data (pdf files). The tutorial is provided at: 00-RAG-chatbot-Introductio...

  • 4947 Views
  • 1 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hey @tholers , here’s how Databricks handles data for the embedding model endpoints and what that means for tenant and data residency requirements. Short answer If you use Databricks-hosted embedding endpoints (for example, GTE-Large or BGE-Large), y...

  • 2 kudos
Khaja_Zaffer
by Contributor III
  • 336 Views
  • 3 replies
  • 1 kudos

GEN AI IN HEALTHCARE

Hello everyone !!Good day!Happy halloween I am just curious to know those who are working with GEN AI or related projects in healthcare. Is GEN AI buzz word finally became a common word or still there is scope in real world projects. How do you this ...

  • 336 Views
  • 3 replies
  • 1 kudos
Latest Reply
bianca_unifeye
Contributor
  • 1 kudos

Hi @Khaja_Zaffer ,Great question  and happy belated Halloween From what we’re seeing across clients in healthcare and life sciences, Generative AI has absolutely moved beyond the buzzword stage. It’s now being operationalised, but selectively, in are...

  • 1 kudos
2 More Replies
ankitmishra
by New Contributor
  • 232 Views
  • 1 replies
  • 0 kudos

Resolved! RAG pipeline in Databricks

We have to implement a RAG pipeline in Databricks using Unity Catalog and Delta tables, We are a databricks partner company, can we have some credits to do over this PoC

  • 232 Views
  • 1 replies
  • 0 kudos
Latest Reply
bianca_unifeye
Contributor
  • 0 kudos

Hi @ankitmishra,Yes, it is definitely possible to request credits for your PoC. The quickest route is to identify the Partner Solution Architect (PSA) assigned to your company account. They can submit the request on your behalf and even attach it to ...

  • 0 kudos
frankc
by New Contributor III
  • 1783 Views
  • 5 replies
  • 6 kudos

OpenAi gpt-oss support for responses API?

I was looking forward to using there openAI responses API when the new gpt-oss models were added to Databricks.The openAI website states these model are compatible with the responses API.However, it does not seem to support it on Databricks. See erro...

  • 1783 Views
  • 5 replies
  • 6 kudos
Latest Reply
CharlotteMarti2
New Contributor III
  • 6 kudos

That’s expected — Databricks’ current GPT-OSS integration only supports /completions and /chat/completions endpoints, not the /responses API yet. The OpenAI Responses API compatibility mentioned on OpenAI’s site applies to OpenAI-hosted models, not t...

  • 6 kudos
4 More Replies
smferro54epam
by New Contributor II
  • 598 Views
  • 4 replies
  • 2 kudos

Can't connect to custom MCP Server

I've tried connecting from local environment, notebook and following the sample notebook here:https://docs.databricks.com/aws/en/generative-ai/mcp/custom-mcp?language=Local+environmentAnd I'm always getting the same error:httpx.ConnectError: All conn...

  • 598 Views
  • 4 replies
  • 2 kudos
Latest Reply
smferro54epam
New Contributor II
  • 2 kudos

I wasn't setting the MCP server as a streamable http, I've done that already and it works!

  • 2 kudos
3 More Replies
old_school
by New Contributor II
  • 448 Views
  • 1 replies
  • 1 kudos

Resolved! Error in output of databricks managed mcp server

Hi Databricks Community,Need suggestions.I have added two functions and I am able to use them. I am using Cursor IDE but in the logs I can see below error,2025-11-01 20:10:23.203 [info] Handling CreateClient action2025-11-01 20:10:23.203 [info] Creat...

  • 448 Views
  • 1 replies
  • 1 kudos
Latest Reply
AbhaySingh
Databricks Employee
  • 1 kudos

The most important thing to know is: Databricks supports external MCP servers only if they use the Streamable HTTP transport mechanism. Client errors related to Streamable HTTP typically occur if the MCP server or client is not compliant with this tr...

  • 1 kudos
manoctch
by New Contributor
  • 227 Views
  • 1 replies
  • 0 kudos

Playground doesn't show tool results

Hii,I’ve created a model in Databricks that uses different tools. One of these tools generates a chart based on data read from Genie.I’d like to visualize this chart (basically an image) in Playground, but so far I haven’t found a way to do it. At th...

  • 227 Views
  • 1 replies
  • 0 kudos
Latest Reply
AbhaySingh
Databricks Employee
  • 0 kudos

  The Issue:   Databricks Playground typically has limited native support for rendering base64 images   directly in the chat interface. This is a known limitation in many AI playground   environments.     Potential Workarounds:     1. Use Markdown Im...

  • 0 kudos
KrzysztofPrzyso
by New Contributor III
  • 4770 Views
  • 1 replies
  • 1 kudos

Accessing UC Volumes using pure python (ML) with databricks-connect

Hi All,In my organization, we use Databricks Connect and VS Code for data engineering purposes. This setup is working great, especially for:- Debugging- Unit tests- GitHub Copilot- Reusable modules and custom librariesIn my view, the developer experi...

  • 4770 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hey @KrzysztofPrzyso , so sorry this question got lost in the shuffle. This is a known architectural limitation with Databricks Connect when working with pure Python file operations and UC Volumes. The issue stems from how Databricks Connect executes...

  • 1 kudos
jAAmes_bentley
by Contributor
  • 4031 Views
  • 1 replies
  • 1 kudos

AI_QUERY fails with o1-mini

As of sometime between March 7th and March 12, the AI_QUERY function has become very temperamental with Azure OpenAI models.Asking a basic question of our Mosaic AI o1-mini serving endpoint using AI_QUERY causes an error sometimes but not every time:...

jAAmes_bentley_0-1741797431261.png
  • 4031 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hello @jAAmes_bentley , I did some digging and here is what I found. Root Cause: Unsupported Temperature Parameter The primary issue with your `AI_QUERY` call to o1-mini is the temperature parameter. OpenAI's o1-series models (o1, o1-mini, o1-preview...

  • 1 kudos
Ajay-Pandey
by Databricks MVP
  • 326 Views
  • 2 replies
  • 0 kudos

Issue while implementation of Use Genie in multi-agent systems

I am testing https://docs.databricks.com/aws/en/generative-ai/agent-framework/multi-agent-genie and looks code is not up to date and it is failing as longchain version upgraded to v1 from v0 that does not support post_model_hook parameter.I tried mul...

  • 326 Views
  • 2 replies
  • 0 kudos
Latest Reply
Harris234
New Contributor II
  • 0 kudos

Hi Ajay, it looks like the Databricks multi-agent Genie docs haven’t been updated for langchain v1. You’ll need to remove or replace the post_model_hook parameter with the new callback or event handling mechanisms in v1. Checking the latest langchain...

  • 0 kudos
1 More Replies
data_scientist3
by New Contributor II
  • 3021 Views
  • 1 replies
  • 0 kudos

Libraries in requirements file not installed when streamlit app is deployed

I deployed a streamlit app on Databricks cluster but the libraries in the requirments.txt file were not installed when the app is deployed. I'm getting this error when a function that uses OpenAI is called."ImportError: Could not import openai python...

  • 3021 Views
  • 1 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

Hi @data_scientist3 , Would you share how you deployed the Streamlit app (Databricks Apps vs running Streamlit from a notebook/job cluster) and your cluster’s Databricks Runtime version? That’ll help me tailor the exact steps to your setup. Option 1:...

  • 0 kudos
RaviSingh0000
by New Contributor
  • 14945 Views
  • 1 replies
  • 1 kudos

Resolved! Genie Space

Hi Team,I would like to use Genie to enable NLP on my delta lake. However, the documentation mention the limitation as 20 messages per minute for a workspace for all Genie Spaces.Is there a pay-as-go model for Genie Space?Regards,Ravi Kumar Singh 

  • 14945 Views
  • 1 replies
  • 1 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 1 kudos

Hi @RaviSingh0000 , 20 messages per minute per workspace across all the spaces is a throughput that Genie currently offers. What is the throughput requirement you have per workspace? It doesn't have a pay-as-you-go model. Currently, it is charged for...

  • 1 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now