cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 38602 Views
  • 22 replies
  • 48 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 38602 Views
  • 22 replies
  • 48 kudos
Latest Reply
Darshan137
New Contributor II
  • 48 kudos

Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...

  • 48 kudos
21 More Replies
raresaxpo
by New Contributor
  • 1962 Views
  • 1 replies
  • 0 kudos

Displaying plots in custom AI Agents

I am trying to build an agent that uses custom functions running python code. However, I can't find a way to make the agent display plots or images. How can I tackle this?

  • 1962 Views
  • 1 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Esteemed Contributor
  • 0 kudos

Hello @raresaxpo Good day!The content was asked from GPT to make a structured response but the whole process is not from GPT. Step-by-Step Guide: Building an AI Data Visualization AgentThis guide provides a detailed walkthrough to help you build a fu...

  • 0 kudos
Vini_Coin
by New Contributor II
  • 1929 Views
  • 2 replies
  • 0 kudos

Sentiment analysis using GEN AI

Has someone started a sentiment analysis in customer surveys using gen AI? How was the experience?

  • 1929 Views
  • 2 replies
  • 0 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 0 kudos

@Vini_Coin I recently did a sentiment analysis on a table and used the AI function ai_analyze_sentiment in databricks it was very simple without needing to write a model or long code. here is the doc if you want to refer.https://learn.microsoft.com/e...

  • 0 kudos
1 More Replies
Tee_O
by New Contributor II
  • 2348 Views
  • 1 replies
  • 1 kudos

Chatbot Deployment Error on Databricks

Hi All,I am trying to deploy a chatbot on databricks and I get this error in the build log:Build could not start due to an internal error. If you are serving a model from UC and Azure storage firewall or Private Link is configured on your storage acc...

  • 2348 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vidhi_Khaitan
Databricks Employee
  • 1 kudos

Hi team,The underlying cause of this issue is an incorrect Network Connectivity Configuration (NCC) for Azure Storage in the Databricks environment. The NCC determines which resources are accessible from within the Databricks environment. If the NCC ...

  • 1 kudos
darioschiraldi9
by New Contributor II
  • 758 Views
  • 0 replies
  • 1 kudos

Newbie Dario Schiraldi, CEO of Travel Works

Hello Community, Hi, I’m Dario Schiraldi, CEO of Travel Works. I’m excited to join the Databricks community to connect with innovators who are shaping the future of data and AI. I’m here to learn, contribute, and collaborate around scalable data solu...

  • 758 Views
  • 0 replies
  • 1 kudos
fcardoze
by New Contributor III
  • 7335 Views
  • 4 replies
  • 1 kudos

Pydantic usage for structured output with provisioned LLM

Hi,I am looking for a resource that has examples of using Pydantic with a provisioned LLM on Databricks to get structured output.I can find many examples of using Pydantic with LLMs, but not on the Databricks.My use case is to extract text from image...

  • 7335 Views
  • 4 replies
  • 1 kudos
Latest Reply
fcardoze
New Contributor III
  • 1 kudos

Thank you!

  • 1 kudos
3 More Replies
vishxlrxghxv
by New Contributor III
  • 4144 Views
  • 4 replies
  • 1 kudos

Resolved! Problem with Review App

I’m trying to deploy a Databricks Review App, but I’m running into the following error.Interestingly, the same code works fine when executed from a Databricks Notebook.Does anyone know what might be going wrong here? Could this be a bug with the Revi...

  • 4144 Views
  • 4 replies
  • 1 kudos
Latest Reply
Amruth_Ashok
Databricks Employee
  • 1 kudos

I recently wrote a KB article on this. Let me know if this helps!TLDR: Databricks Apps are lightweight, container-based runtimes designed for UI rendering and light orchestration. They do not ship with an Apache Spark driver, executor, or JVM. Any ca...

  • 1 kudos
3 More Replies
prakashhinduja
by New Contributor III
  • 4267 Views
  • 5 replies
  • 5 kudos

Prakash Hinduja Switzerland (Swiss) How do I build a RAG pipeline on Databricks?

Hello DataBricks Community,I'm Prakash Hinduja from Geneva, Switzerland (Swiss). As a financial strategist, I play an active role in strengthening the Swiss investment market. By connecting global investors with high-potential opportunities across Sw...

  • 4267 Views
  • 5 replies
  • 5 kudos
Latest Reply
simonsmart
New Contributor II
  • 5 kudos

@Khaja_Zaffer It's actually a weird type of spam - see simon-smart88/Hinduja_spam on GitHub. I've reported this post.

  • 5 kudos
4 More Replies
SandipCoder
by New Contributor II
  • 4874 Views
  • 1 replies
  • 0 kudos

How can we deploy a custom model

Goal:Let's say we have a custom function with arbitrary python code . And we want to deploy that as model as we wanted to generate an API endpoint .So that that can be accessed from external applications.I am attaching the below code I have tried .If...

Generative AI
GenAI
modelcreation
  • 4874 Views
  • 1 replies
  • 0 kudos
Latest Reply
Vidhi_Khaitan
Databricks Employee
  • 0 kudos

Hi @SandipCoder I believe that you are not seeing an output because you're calling the MLflow model via a REST API endpoint. MLflow’s REST API expects the inputs to be a DataFrame-like structure, not just a single string.Instead of passing this - {"i...

  • 0 kudos
yvesbeutler
by New Contributor III
  • 3503 Views
  • 2 replies
  • 3 kudos

Resolved! Can Genie ask clarifying questions?

I am looking for a way to force Genie to ask questions when an instruction is not entirely clear. Are there specific options or instructions that I could use for this, or is it managed internally by Databricks and we cannot adjust it?I would like Gen...

  • 3503 Views
  • 2 replies
  • 3 kudos
Latest Reply
Sharanya13
Contributor III
  • 3 kudos

Thanks @Vinay_M_R for the detailed explanation. It's good to know that Genie can ask clarifying questions.

  • 3 kudos
1 More Replies
dbx_beginner_10
by New Contributor II
  • 2189 Views
  • 2 replies
  • 1 kudos

Vector Search Indexes on dlt pipelines / materialized views

Hello, I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt. Is this expected behavior?

  • 2189 Views
  • 2 replies
  • 1 kudos
Latest Reply
dbx_beginner_10
New Contributor II
  • 1 kudos

Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I...

  • 1 kudos
1 More Replies
ChrisChan
by New Contributor III
  • 10354 Views
  • 6 replies
  • 6 kudos

Resolved! Databricks AI Genie - Data Security and Thrid Party Platform

I am currently exploring the possibility of using Databricks AI Genie to allow layman users to ask questions and retrieve data on their own.We would like to keep the data in our warehouse (e.g., Snowflake or local). I read the documentation, but it s...

  • 10354 Views
  • 6 replies
  • 6 kudos
Latest Reply
k1chi
New Contributor II
  • 6 kudos

Genie allows you to use serverless as well as classic compute (sql warehouse). Classic compute runs within your tenant using your vpc/vnet. Irrespective of the type of compute you use, data needs to be read into it and this applies to any other solut...

  • 6 kudos
5 More Replies
llIIlI1ll1II
by New Contributor III
  • 2779 Views
  • 2 replies
  • 2 kudos

Is it possible to run Databricks Genie entirely within a private network ?

We're considering using Databricks Genie in a secure environment. Is there a way to run Genie fully on an internal network without requiring outbound internet access?

  • 2779 Views
  • 2 replies
  • 2 kudos
Latest Reply
llIIlI1ll1II
New Contributor III
  • 2 kudos

Thank you @charlie_wei We're actually using AWS.Is it not possible to establish a private connection on AWS?(Certain financial institutions in specific countries are not allowed to communicate with external LLMs over the internet.)

  • 2 kudos
1 More Replies
Pratikmsbsvm
by Contributor
  • 2135 Views
  • 1 replies
  • 1 kudos

Production Grade AI system with Agents capability in Databricks

Design AI System for Customer Sentiments Analysis with Agentic Bot.May someone please share how to architect such system in Databricks.Infrastructure on AzureData PipelineModel TrainingModel TestingChoosing Best ModelModel DeploymentModel ConsumtionP...

  • 2135 Views
  • 1 replies
  • 1 kudos
Latest Reply
TheOC
Databricks Partner
  • 1 kudos

hi @Pratikmsbsvm That feels like a good sized project. My recommendation would be starting with a similar project and working from there. This might be a useful source for you to understand how this will look: https://www.databricks.com/blog/step-ste...

  • 1 kudos
thunder-07
by New Contributor II
  • 1885 Views
  • 2 replies
  • 0 kudos

Couldn't fine claude 4 models on Databricks azure

Although it says they are available I couldn't fine them in databricks azure it's the same with https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-modelshttps://learn.microsoft.com/en-us/answers/questi...

  • 1885 Views
  • 2 replies
  • 0 kudos
Latest Reply
thunder-07
New Contributor II
  • 0 kudos

@nayan_wylde It's a premium one.

  • 0 kudos
1 More Replies