cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 29887 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 29887 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
alxsbn
by Contributor
  • 1355 Views
  • 1 replies
  • 1 kudos

Resolved! Databricks Managed MCP server x Claude Code

Hi everyone,I'm looking to connect the managed MCP server to Claude code on Linux and struggle to have something working. The MCP are activated on my workspace (not sure it's linked to what I want to do) and I just want to add the UC endpoint to Clau...

  • 1355 Views
  • 1 replies
  • 1 kudos
Latest Reply
jamesl
Databricks Employee
  • 1 kudos

Hi @alxsbn , did you get this resolved? Targets that are a remote HTTP endpoint need `--transport http`. For example... claude mcp add --transport http databricks-server https://xx-yyy-zzz.cloud.databricks.com/api/2.0/mcp/gold/core (see: https://docs...

  • 1 kudos
sathyavikasini
by New Contributor
  • 615 Views
  • 1 replies
  • 1 kudos

Error while creating Agents with Agentbricks UI

While creating a Knowledge Assistant in Databricks, I encountered an issue where the endpoint update failed with the following message:"Failed to deploy: served entity creation aborted because the endpoint update timed out. Please see service logs fo...

sathyavikasini_0-1754497230496.png sathyavikasini_3-1754497718786.png sathyavikasini_4-1754497745047.png
  • 615 Views
  • 1 replies
  • 1 kudos
Latest Reply
jamesl
Databricks Employee
  • 1 kudos

  Hi @sathyavikasini , Are you still facing this issue? While creating the agent, do you see that your configured knowledge sources are processing? If you haven't done so already, you might check permissions on the catalog/schema/volume(s) that are ...

  • 1 kudos
magicianmanan
by New Contributor
  • 391 Views
  • 1 replies
  • 0 kudos

Problem selecting data in Agents: Knowledge assistant

Hi Community, I am trying to add my unlabeled data such as txt, ppt, and pdf but none of them can be selected to usage. Please see a screenshot as I am trying to create a knowledge assistant agent, so I can feed it files and it can answer questions f...

Generative AI
agents
Gen AI agents
knowledge assistant
  • 391 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @magicianmanan ,In source parameter you need to provide path to the folder, not to specific file.So, for instance in my volume I have one single pdf:And in source parameter I'm providing path to directory that contains that PDF file (but not the p...

  • 0 kudos
Sujitha
by Databricks Employee
  • 7030 Views
  • 2 replies
  • 8 kudos

How to successfully build GenAI applications

The Big Book of Generative AI brings together best practices and know-how for building production-quality GenAI applications. You’ll find technical content and code samples that will help you do everything from deploying your first application to bui...

Screenshot 2024-04-23 at 8.10.12 AM.png
  • 7030 Views
  • 2 replies
  • 8 kudos
Latest Reply
ramnarayanan
New Contributor II
  • 8 kudos

To successfully Build AI Software  with GenAI, focus on RAG pipelines for context-rich apps, fine-tuning or training models for domain needs, and robust evaluation for reliability. Using architectural patterns like modular microservices ensures scala...

  • 8 kudos
1 More Replies
DinoSaluzzi
by New Contributor III
  • 590 Views
  • 1 replies
  • 2 kudos

Resolved! Authentication error when calling Databricks foundational model endpoint from pandas udf

Hi everyone! I’m running into an authentication error when trying to call a Databricks foundational model endpoint inside a pandas UDF. I’m using the ChatDatabricks wrapper to make completions, and this setup was working properly until last week (ima...

  • 590 Views
  • 1 replies
  • 2 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 2 kudos

Hey DinoSaluzzi - Thanks for reaching out! The error message you're seeing—ValueError: default auth: runtime: default auth: cannot configure default credentials—reflects a stricter enforcement in how authentication happens within Spark worker nodes r...

  • 2 kudos
amit_eha
by New Contributor
  • 419 Views
  • 2 replies
  • 3 kudos

Resolved! Permission denied - Genie conversation feedback API

Hi all,I am trying to use the send_message_feedback Python SDK function to post a feedback for a genie message. However, getting this error:databricks.sdk.errors.platform.PermissionDenied: This API is not yet supported.Any ideas as to where the issue...

  • 419 Views
  • 2 replies
  • 3 kudos
Latest Reply
nayan_wylde
Esteemed Contributor
  • 3 kudos

@amit_eha Can you please share the code.

  • 3 kudos
1 More Replies
MarsWalker
by New Contributor II
  • 3897 Views
  • 1 replies
  • 1 kudos

How to serve a RAG chain endpoint that supports streaming

Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...

  • 3897 Views
  • 1 replies
  • 1 kudos
Latest Reply
ciroskiviktor
New Contributor II
  • 1 kudos

Hello, This seems like a very relevant question, and is the second link to popup on a google search of the topic. Are there any additional resources that I could look into or we could link to this post? Thank you, Viktor Ciroski https://www.linkedin....

  • 1 kudos
aiohi
by New Contributor
  • 358 Views
  • 1 replies
  • 0 kudos

Access to Claude on Playground

I was wondering how we could enable the use of Claude Opus 4 in our Playground environment?Thank you!

  • 358 Views
  • 1 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 0 kudos

Hello @aiohi Good day!!Databricks has recently integrated Anthropic's latest models, Claude Opus 4 into our platform as part of a partnership with Anthropic announced on March 26, 2025. Opus will be available in Databricks Mosaic AI as additional fir...

  • 0 kudos
atharvaghodekar
by New Contributor III
  • 921 Views
  • 5 replies
  • 5 kudos

Resolved! Databricks Free Edition - AI Agent Export Limitation

Hi, I am following the Databricks AI Agent guide to create a custom agent using my functions. However, in the Free Edition, I do not see the option to export the agent from the Playground. Is this feature unavailable in Free Edition, or is there a wo...

  • 921 Views
  • 5 replies
  • 5 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 5 kudos

Ok @atharvaghodekar , so there's no export button (neither on premium workspace as @WiliamRosa stated above).I think they refactor UI and now the same functionality is under Tools -> Create agent notebook.  So, in tutorial export button is reposonsib...

  • 5 kudos
4 More Replies
DinoSaluzzi
by New Contributor III
  • 1181 Views
  • 3 replies
  • 2 kudos

How to implement prompt caching using Claude models?

Hi, I am trying to use prompt caching future using claude "databricks-claude-sonnet-4" databricks endpoint (wrapped in a ChatDatabricks instance). Using langchain, I set  SystemMessage( content=[ { ...

Generative AI
ChatDatabricks
Prompt caching
  • 1181 Views
  • 3 replies
  • 2 kudos
Latest Reply
XianCao_98793
New Contributor II
  • 2 kudos

Hi @WiliamRosa good day.We have Azure Databricks customer asked the same question and would like to know if you have roadmap to make this work in Serving Endpoint?Customer mentioned, it seems like AWS Bedrock support  prompt cache feature...

  • 2 kudos
2 More Replies
ajay-hinduja
by New Contributor
  • 469 Views
  • 1 replies
  • 1 kudos

Resolved! Ajay Hinduja (Switzerland) How can I schedule a notebook to run automatically?

Hi I am Ajay Hinduja, from Punjab, India, and currently residing in Geneva, Switzerland (Swiss). I am exploring ways to automate a Jupyter/Colab notebook to run on a schedule. I have looked into a few options like using cronjobs or Google Apps Script...

  • 469 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @ajay-hinduja ,You can use Lakeflow Jobs to do that with task type - notebookLakeflow Jobs | Databricks on AWS

  • 1 kudos
BBland
by New Contributor
  • 906 Views
  • 2 replies
  • 1 kudos

Missing Claude models

Hi,We are on premium workspace and until last week we had Claude models visable.  Now they seemed to have disappeared, do you know what could have caused the disappearance? 

  • 906 Views
  • 2 replies
  • 1 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 1 kudos

Also to add, make sure you check those models are retired? 

  • 1 kudos
1 More Replies
akhter0786
by New Contributor
  • 25258 Views
  • 2 replies
  • 2 kudos

Resolved! Gen AI Agents

Guidance Request: Gen AI Agentic Course for a Non-Technical ProfessionalDear Databricks Training & Support Team,My name is [Your Name], and I am writing to express my strong interest in your free Gen AI Agentic Course. I am very excited by the prospe...

  • 25258 Views
  • 2 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

To add to a @Khaja_Zaffer  great response, you can also take following course for free in databricks academy. They should provide clear and structured path to grasp fundamentals:- Databricks Generative AI Fundamentals Learning Plan - Databricks Learn...

  • 2 kudos
1 More Replies
damselfly20
by New Contributor III
  • 511 Views
  • 1 replies
  • 1 kudos

Inference table not working for Gemma 3 12b

Hi, I have a problem regarding the inference table for Gemma 3 12b. If I create a serving endpoint for the model (from system.ai.gemma-3-12b-it) with an inference table, the inference table is being created, but it always stays empty. No matter how m...

create_gemma_serving_endpoint.png
  • 511 Views
  • 1 replies
  • 1 kudos
Latest Reply
Yogesh_Verma_
Contributor
  • 1 kudos

The endpoint is working since you’re receiving responses, but the inference table isn’t capturing any records. This points to a logging/compatibility issue rather than request handling. Please confirm inference logging is enabled, verify permissions,...

  • 1 kudos
Joy233
by New Contributor II
  • 712 Views
  • 1 replies
  • 3 kudos

Resolved! Genie properties management, how to import/export?

Does anyone know how to import/export Genie space properties, such as instructions, trusted assets and column comments? Try to find an automated way to manage the genie space in dev/prod stage and ensure consistency among developers.I noticed when I ...

  • 712 Views
  • 1 replies
  • 3 kudos
Latest Reply
Advika
Databricks Employee
  • 3 kudos

Hello @Joy233! Currently, there’s no built-in feature for importing or exporting Genie Spaces. For now, you’ll need to manually manage metadata until the team introduces this capability in future.

  • 3 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now