cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 29967 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 29967 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
HemantvIkani32
by New Contributor II
  • 886 Views
  • 2 replies
  • 1 kudos

LLAMA3.1 logging using mlflow

Hi team, I am facing issue after registering the meta llama 3.1 8b instruct model, while serving i get the response like{error code: BAD REQUEST, "message": "Time out while evaluating the model. Verify that the model evaluate within the timeframe."Gi...

  • 886 Views
  • 2 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @HemantvIkani32! Did the above suggestion help resolve your issue? If yes, please consider marking it as the accepted solution. If you found another approach, it would be great if you could share it with the community.

  • 1 kudos
1 More Replies
Phani1
by Valued Contributor II
  • 1581 Views
  • 2 replies
  • 1 kudos

Preserving Intelligence and Learning during Genie Space Migration

Hi Team,How can we migrate a Genie space to a higher environment while preserving its existing intelligence and learning, along with the catalog, to avoid recreating the same knowledge.Regards,Phani

  • 1581 Views
  • 2 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Okay, maybe I’ll bring up an uncomfortable topic and ask why we should even bother trying to help you if you can’t dedicate five minutes of your time to let us know whether a suggestion or reply worked. We are spending our free time answering questio...

  • 1 kudos
1 More Replies
Tee_O
by New Contributor II
  • 1345 Views
  • 1 replies
  • 0 kudos

Resolved! Viewing logged User input and LLM response for a Deployed Chatbot

Hi All, I deployed a simple chatbot on Databricks Free Edition and I am trying to find the location where the user input and llm response are stored (logged) when a user asks a question (I assumed this would be in the payload table created but couldn...

  • 1345 Views
  • 1 replies
  • 0 kudos
Latest Reply
jamesl
Databricks Employee
  • 0 kudos

Hi @Tee_O , are you still facing this issue?If you see (or saw) the payload table in your catalog but didn't see any rows/entries, it's probably just a time delay issue -- it can take up to 1 hr for the logs to appear. If you *don't* see the table th...

  • 0 kudos
atharvaghodekar
by New Contributor III
  • 278 Views
  • 1 replies
  • 0 kudos

How to authenticate Vector Search Retriever Tool in Databricks AI Agent App?

I’m getting the following error while building a Databricks AI Agent app:databricks.vector_search.exceptions.InvalidInputException: Please specify either personal access token or service principal client ID and secret.My code looks like this: vector_...

  • 278 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @atharvaghodekar ,AI agents support 3 authentication methods:- automatic authentication passthrough-  on-behalf-of-use authentication (OBO)- manual authentication In case of manual authentication you need to explicitly provide credentials using en...

  • 0 kudos
alxsbn
by Contributor
  • 1378 Views
  • 1 replies
  • 1 kudos

Resolved! Databricks Managed MCP server x Claude Code

Hi everyone,I'm looking to connect the managed MCP server to Claude code on Linux and struggle to have something working. The MCP are activated on my workspace (not sure it's linked to what I want to do) and I just want to add the UC endpoint to Clau...

  • 1378 Views
  • 1 replies
  • 1 kudos
Latest Reply
jamesl
Databricks Employee
  • 1 kudos

Hi @alxsbn , did you get this resolved? Targets that are a remote HTTP endpoint need `--transport http`. For example... claude mcp add --transport http databricks-server https://xx-yyy-zzz.cloud.databricks.com/api/2.0/mcp/gold/core (see: https://docs...

  • 1 kudos
sathyavikasini
by New Contributor
  • 631 Views
  • 1 replies
  • 1 kudos

Error while creating Agents with Agentbricks UI

While creating a Knowledge Assistant in Databricks, I encountered an issue where the endpoint update failed with the following message:"Failed to deploy: served entity creation aborted because the endpoint update timed out. Please see service logs fo...

sathyavikasini_0-1754497230496.png sathyavikasini_3-1754497718786.png sathyavikasini_4-1754497745047.png
  • 631 Views
  • 1 replies
  • 1 kudos
Latest Reply
jamesl
Databricks Employee
  • 1 kudos

  Hi @sathyavikasini , Are you still facing this issue? While creating the agent, do you see that your configured knowledge sources are processing? If you haven't done so already, you might check permissions on the catalog/schema/volume(s) that are ...

  • 1 kudos
magicianmanan
by New Contributor
  • 404 Views
  • 1 replies
  • 0 kudos

Problem selecting data in Agents: Knowledge assistant

Hi Community, I am trying to add my unlabeled data such as txt, ppt, and pdf but none of them can be selected to usage. Please see a screenshot as I am trying to create a knowledge assistant agent, so I can feed it files and it can answer questions f...

Generative AI
agents
Gen AI agents
knowledge assistant
  • 404 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @magicianmanan ,In source parameter you need to provide path to the folder, not to specific file.So, for instance in my volume I have one single pdf:And in source parameter I'm providing path to directory that contains that PDF file (but not the p...

  • 0 kudos
Sujitha
by Databricks Employee
  • 7053 Views
  • 2 replies
  • 8 kudos

How to successfully build GenAI applications

The Big Book of Generative AI brings together best practices and know-how for building production-quality GenAI applications. You’ll find technical content and code samples that will help you do everything from deploying your first application to bui...

Screenshot 2024-04-23 at 8.10.12 AM.png
  • 7053 Views
  • 2 replies
  • 8 kudos
Latest Reply
ramnarayanan
New Contributor II
  • 8 kudos

To successfully Build AI Software  with GenAI, focus on RAG pipelines for context-rich apps, fine-tuning or training models for domain needs, and robust evaluation for reliability. Using architectural patterns like modular microservices ensures scala...

  • 8 kudos
1 More Replies
DinoSaluzzi
by New Contributor III
  • 601 Views
  • 1 replies
  • 2 kudos

Resolved! Authentication error when calling Databricks foundational model endpoint from pandas udf

Hi everyone! I’m running into an authentication error when trying to call a Databricks foundational model endpoint inside a pandas UDF. I’m using the ChatDatabricks wrapper to make completions, and this setup was working properly until last week (ima...

  • 601 Views
  • 1 replies
  • 2 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 2 kudos

Hey DinoSaluzzi - Thanks for reaching out! The error message you're seeing—ValueError: default auth: runtime: default auth: cannot configure default credentials—reflects a stricter enforcement in how authentication happens within Spark worker nodes r...

  • 2 kudos
amit_eha
by New Contributor
  • 431 Views
  • 2 replies
  • 3 kudos

Resolved! Permission denied - Genie conversation feedback API

Hi all,I am trying to use the send_message_feedback Python SDK function to post a feedback for a genie message. However, getting this error:databricks.sdk.errors.platform.PermissionDenied: This API is not yet supported.Any ideas as to where the issue...

  • 431 Views
  • 2 replies
  • 3 kudos
Latest Reply
nayan_wylde
Esteemed Contributor
  • 3 kudos

@amit_eha Can you please share the code.

  • 3 kudos
1 More Replies
MarsWalker
by New Contributor II
  • 3983 Views
  • 1 replies
  • 1 kudos

How to serve a RAG chain endpoint that supports streaming

Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...

  • 3983 Views
  • 1 replies
  • 1 kudos
Latest Reply
ciroskiviktor
New Contributor II
  • 1 kudos

Hello, This seems like a very relevant question, and is the second link to popup on a google search of the topic. Are there any additional resources that I could look into or we could link to this post? Thank you, Viktor Ciroski https://www.linkedin....

  • 1 kudos
aiohi
by New Contributor
  • 367 Views
  • 1 replies
  • 0 kudos

Access to Claude on Playground

I was wondering how we could enable the use of Claude Opus 4 in our Playground environment?Thank you!

  • 367 Views
  • 1 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 0 kudos

Hello @aiohi Good day!!Databricks has recently integrated Anthropic's latest models, Claude Opus 4 into our platform as part of a partnership with Anthropic announced on March 26, 2025. Opus will be available in Databricks Mosaic AI as additional fir...

  • 0 kudos
atharvaghodekar
by New Contributor III
  • 998 Views
  • 5 replies
  • 5 kudos

Resolved! Databricks Free Edition - AI Agent Export Limitation

Hi, I am following the Databricks AI Agent guide to create a custom agent using my functions. However, in the Free Edition, I do not see the option to export the agent from the Playground. Is this feature unavailable in Free Edition, or is there a wo...

  • 998 Views
  • 5 replies
  • 5 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 5 kudos

Ok @atharvaghodekar , so there's no export button (neither on premium workspace as @WiliamRosa stated above).I think they refactor UI and now the same functionality is under Tools -> Create agent notebook.  So, in tutorial export button is reposonsib...

  • 5 kudos
4 More Replies
DinoSaluzzi
by New Contributor III
  • 1236 Views
  • 3 replies
  • 2 kudos

How to implement prompt caching using Claude models?

Hi, I am trying to use prompt caching future using claude "databricks-claude-sonnet-4" databricks endpoint (wrapped in a ChatDatabricks instance). Using langchain, I set  SystemMessage( content=[ { ...

Generative AI
ChatDatabricks
Prompt caching
  • 1236 Views
  • 3 replies
  • 2 kudos
Latest Reply
XianCao_98793
New Contributor II
  • 2 kudos

Hi @WiliamRosa good day.We have Azure Databricks customer asked the same question and would like to know if you have roadmap to make this work in Serving Endpoint?Customer mentioned, it seems like AWS Bedrock support  prompt cache feature...

  • 2 kudos
2 More Replies
ajay-hinduja
by New Contributor
  • 477 Views
  • 1 replies
  • 1 kudos

Resolved! Ajay Hinduja (Switzerland) How can I schedule a notebook to run automatically?

Hi I am Ajay Hinduja, from Punjab, India, and currently residing in Geneva, Switzerland (Swiss). I am exploring ways to automate a Jupyter/Colab notebook to run on a schedule. I have looked into a few options like using cronjobs or Google Apps Script...

  • 477 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @ajay-hinduja ,You can use Lakeflow Jobs to do that with task type - notebookLakeflow Jobs | Databricks on AWS

  • 1 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now