cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 29199 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 29199 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
sathyavikasini
by New Contributor
  • 565 Views
  • 1 replies
  • 1 kudos

Error while creating Agents with Agentbricks UI

While creating a Knowledge Assistant in Databricks, I encountered an issue where the endpoint update failed with the following message:"Failed to deploy: served entity creation aborted because the endpoint update timed out. Please see service logs fo...

sathyavikasini_0-1754497230496.png sathyavikasini_3-1754497718786.png sathyavikasini_4-1754497745047.png
  • 565 Views
  • 1 replies
  • 1 kudos
Latest Reply
jamesl
Databricks Employee
  • 1 kudos

  Hi @sathyavikasini , Are you still facing this issue? While creating the agent, do you see that your configured knowledge sources are processing? If you haven't done so already, you might check permissions on the catalog/schema/volume(s) that are ...

  • 1 kudos
magicianmanan
by New Contributor
  • 334 Views
  • 1 replies
  • 0 kudos

Problem selecting data in Agents: Knowledge assistant

Hi Community, I am trying to add my unlabeled data such as txt, ppt, and pdf but none of them can be selected to usage. Please see a screenshot as I am trying to create a knowledge assistant agent, so I can feed it files and it can answer questions f...

Generative AI
agents
Gen AI agents
knowledge assistant
  • 334 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @magicianmanan ,In source parameter you need to provide path to the folder, not to specific file.So, for instance in my volume I have one single pdf:And in source parameter I'm providing path to directory that contains that PDF file (but not the p...

  • 0 kudos
Sujitha
by Databricks Employee
  • 6889 Views
  • 2 replies
  • 8 kudos

How to successfully build GenAI applications

The Big Book of Generative AI brings together best practices and know-how for building production-quality GenAI applications. You’ll find technical content and code samples that will help you do everything from deploying your first application to bui...

Screenshot 2024-04-23 at 8.10.12 AM.png
  • 6889 Views
  • 2 replies
  • 8 kudos
Latest Reply
ramnarayanan
New Contributor II
  • 8 kudos

To successfully Build AI Software  with GenAI, focus on RAG pipelines for context-rich apps, fine-tuning or training models for domain needs, and robust evaluation for reliability. Using architectural patterns like modular microservices ensures scala...

  • 8 kudos
1 More Replies
DinoSaluzzi
by New Contributor III
  • 506 Views
  • 1 replies
  • 2 kudos

Resolved! Authentication error when calling Databricks foundational model endpoint from pandas udf

Hi everyone! I’m running into an authentication error when trying to call a Databricks foundational model endpoint inside a pandas UDF. I’m using the ChatDatabricks wrapper to make completions, and this setup was working properly until last week (ima...

  • 506 Views
  • 1 replies
  • 2 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 2 kudos

Hey DinoSaluzzi - Thanks for reaching out! The error message you're seeing—ValueError: default auth: runtime: default auth: cannot configure default credentials—reflects a stricter enforcement in how authentication happens within Spark worker nodes r...

  • 2 kudos
amit_eha
by New Contributor
  • 353 Views
  • 2 replies
  • 3 kudos

Resolved! Permission denied - Genie conversation feedback API

Hi all,I am trying to use the send_message_feedback Python SDK function to post a feedback for a genie message. However, getting this error:databricks.sdk.errors.platform.PermissionDenied: This API is not yet supported.Any ideas as to where the issue...

  • 353 Views
  • 2 replies
  • 3 kudos
Latest Reply
nayan_wylde
Honored Contributor III
  • 3 kudos

@amit_eha Can you please share the code.

  • 3 kudos
1 More Replies
MarsWalker
by New Contributor II
  • 3672 Views
  • 1 replies
  • 1 kudos

How to serve a RAG chain endpoint that supports streaming

Hello everyone,I am trying to serve a sample RAG chain model that should support streaming output. But I could not find any documantation on how to enable streaming for a serving endpoint for a langchain model. Could you provide some hints on how to ...

  • 3672 Views
  • 1 replies
  • 1 kudos
Latest Reply
ciroskiviktor
New Contributor II
  • 1 kudos

Hello, This seems like a very relevant question, and is the second link to popup on a google search of the topic. Are there any additional resources that I could look into or we could link to this post? Thank you, Viktor Ciroski https://www.linkedin....

  • 1 kudos
aiohi
by New Contributor
  • 266 Views
  • 1 replies
  • 0 kudos

Access to Claude on Playground

I was wondering how we could enable the use of Claude Opus 4 in our Playground environment?Thank you!

  • 266 Views
  • 1 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 0 kudos

Hello @aiohi Good day!!Databricks has recently integrated Anthropic's latest models, Claude Opus 4 into our platform as part of a partnership with Anthropic announced on March 26, 2025. Opus will be available in Databricks Mosaic AI as additional fir...

  • 0 kudos
atharvaghodekar
by New Contributor III
  • 636 Views
  • 5 replies
  • 5 kudos

Resolved! Databricks Free Edition - AI Agent Export Limitation

Hi, I am following the Databricks AI Agent guide to create a custom agent using my functions. However, in the Free Edition, I do not see the option to export the agent from the Playground. Is this feature unavailable in Free Edition, or is there a wo...

  • 636 Views
  • 5 replies
  • 5 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 5 kudos

Ok @atharvaghodekar , so there's no export button (neither on premium workspace as @WiliamRosa stated above).I think they refactor UI and now the same functionality is under Tools -> Create agent notebook.  So, in tutorial export button is reposonsib...

  • 5 kudos
4 More Replies
DinoSaluzzi
by New Contributor III
  • 959 Views
  • 3 replies
  • 2 kudos

How to implement prompt caching using Claude models?

Hi, I am trying to use prompt caching future using claude "databricks-claude-sonnet-4" databricks endpoint (wrapped in a ChatDatabricks instance). Using langchain, I set  SystemMessage( content=[ { ...

Generative AI
ChatDatabricks
Prompt caching
  • 959 Views
  • 3 replies
  • 2 kudos
Latest Reply
XianCao_98793
New Contributor II
  • 2 kudos

Hi @WiliamRosa good day.We have Azure Databricks customer asked the same question and would like to know if you have roadmap to make this work in Serving Endpoint?Customer mentioned, it seems like AWS Bedrock support  prompt cache feature...

  • 2 kudos
2 More Replies
frankc
by New Contributor III
  • 1024 Views
  • 3 replies
  • 5 kudos

OpenAi gpt-oss support for responses API?

I was looking forward to using there openAI responses API when the new gpt-oss models were added to Databricks.The openAI website states these model are compatible with the responses API.However, it does not seem to support it on Databricks. See erro...

  • 1024 Views
  • 3 replies
  • 5 kudos
Latest Reply
powerofzero
New Contributor II
  • 5 kudos

Hi Frank, I too have been waiting for responses API to become available, but with Azure. I'm sorta suprised more people haven't been asking for it. In one of their first blogs about it in early August, Azure said they would be making responses API av...

  • 5 kudos
2 More Replies
ajay-hinduja
by New Contributor
  • 431 Views
  • 1 replies
  • 1 kudos

Resolved! Ajay Hinduja (Switzerland) How can I schedule a notebook to run automatically?

Hi I am Ajay Hinduja, from Punjab, India, and currently residing in Geneva, Switzerland (Swiss). I am exploring ways to automate a Jupyter/Colab notebook to run on a schedule. I have looked into a few options like using cronjobs or Google Apps Script...

  • 431 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @ajay-hinduja ,You can use Lakeflow Jobs to do that with task type - notebookLakeflow Jobs | Databricks on AWS

  • 1 kudos
BBland
by New Contributor
  • 497 Views
  • 2 replies
  • 1 kudos

Missing Claude models

Hi,We are on premium workspace and until last week we had Claude models visable.  Now they seemed to have disappeared, do you know what could have caused the disappearance? 

  • 497 Views
  • 2 replies
  • 1 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 1 kudos

Also to add, make sure you check those models are retired? 

  • 1 kudos
1 More Replies
akhter0786
by New Contributor
  • 23481 Views
  • 2 replies
  • 2 kudos

Resolved! Gen AI Agents

Guidance Request: Gen AI Agentic Course for a Non-Technical ProfessionalDear Databricks Training & Support Team,My name is [Your Name], and I am writing to express my strong interest in your free Gen AI Agentic Course. I am very excited by the prospe...

  • 23481 Views
  • 2 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

To add to a @Khaja_Zaffer  great response, you can also take following course for free in databricks academy. They should provide clear and structured path to grasp fundamentals:- Databricks Generative AI Fundamentals Learning Plan - Databricks Learn...

  • 2 kudos
1 More Replies
damselfly20
by New Contributor III
  • 391 Views
  • 1 replies
  • 1 kudos

Inference table not working for Gemma 3 12b

Hi, I have a problem regarding the inference table for Gemma 3 12b. If I create a serving endpoint for the model (from system.ai.gemma-3-12b-it) with an inference table, the inference table is being created, but it always stays empty. No matter how m...

create_gemma_serving_endpoint.png
  • 391 Views
  • 1 replies
  • 1 kudos
Latest Reply
Yogesh_Verma_
Contributor
  • 1 kudos

The endpoint is working since you’re receiving responses, but the inference table isn’t capturing any records. This points to a logging/compatibility issue rather than request handling. Please confirm inference logging is enabled, verify permissions,...

  • 1 kudos
Joy233
by New Contributor II
  • 635 Views
  • 1 replies
  • 3 kudos

Resolved! Genie properties management, how to import/export?

Does anyone know how to import/export Genie space properties, such as instructions, trusted assets and column comments? Try to find an automated way to manage the genie space in dev/prod stage and ensure consistency among developers.I noticed when I ...

  • 635 Views
  • 1 replies
  • 3 kudos
Latest Reply
Advika
Databricks Employee
  • 3 kudos

Hello @Joy233! Currently, there’s no built-in feature for importing or exporting Genie Spaces. For now, you’ll need to manually manage metadata until the team introduces this capability in future.

  • 3 kudos