cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Generative AI

Forum Posts

Sujitha
by Community Manager
  • 15035 Views
  • 6 replies
  • 11 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 15035 Views
  • 6 replies
  • 11 kudos
Latest Reply
KhileshKhubnani
New Contributor III
  • 11 kudos

Thanks for sharing 

  • 11 kudos
5 More Replies
Anureka
by New Contributor II
  • 1380 Views
  • 2 replies
  • 1 kudos

Gen AI Fundamentals Badge

I'm trying to take the quiz and get the badge for Gen AI Fundamentals, but unfortunately unable to do so as the login credentials aren't letting me in. Please advice where to find the link to take the quiz here.

  • 1380 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anureka
New Contributor II
  • 1 kudos

Thank you @Kaniz_Fatma i have logged the ticket. Your request #00482921 has been received. 

  • 1 kudos
1 More Replies
cmunteanu
by Contributor
  • 5748 Views
  • 3 replies
  • 2 kudos

Resolved! Dbdemo: LLM Chatbot With Retrieval Augmented Generation (RAG)

Hello All,I am trying to follow the dbdemo called 'llm-rag-chatbot' available at the following link. The setup works Ok, and I have imported from the Databricks Marketplace an embedding model that is:bge_large_en_v1_5Running the notebook called: 01-D...

  • 5748 Views
  • 3 replies
  • 2 kudos
Latest Reply
jbellidocaceres
New Contributor II
  • 2 kudos

Hi  @Kaniz_Fatma  and  @cmunteanu  , I am having exactly the same problem to create the vector index and it seems that there could be a bug in the demo. What confuses me is that and even when using the Databricks UI, I can not manage to create the ve...

  • 2 kudos
2 More Replies
jbellidocaceres
by New Contributor II
  • 2575 Views
  • 2 replies
  • 2 kudos

can't run the agent-studio RAG DBRX chatbot example

Hi,  I have apparently successfully the deployed the agent-studio RAG DBRX and  chatbot example from:https://github.com/rmosleydb/agent-studioHowever, when entering a question in the chatbot box, I get an error message. The  error says that it can't ...

  • 2575 Views
  • 2 replies
  • 2 kudos
Latest Reply
jbellidocaceres
New Contributor II
  • 2 kudos

Hi @Kaniz_Fatma ,  thank you for the hints. I will give a closer look to the  input schema and the Vector Search endpoint.

  • 2 kudos
1 More Replies
Amit_Dass_Chmp
by New Contributor III
  • 1123 Views
  • 1 replies
  • 0 kudos

How we can choose the right LLM model, also considering the cost.

Hi All, I understand we are in the evaluation journey where we have 100+ LLMs (Open or Proprietary models ), but please guide us on how we can choose the right LLM model, also considering the cost. Do we have any benchmark to follow considering the u...

  • 1123 Views
  • 1 replies
  • 0 kudos
Latest Reply
mhiltner
Esteemed Contributor III
  • 0 kudos

Hey! It depends a lot on your application. Different LLMs excel in different functions. Proprietary models will be more expensive then Open Source ones, but they will likely lead you to a faster time to production with your applications.  Also, if yo...

  • 0 kudos
Abhishek_blue
by New Contributor
  • 1529 Views
  • 1 replies
  • 0 kudos

Is enabling Unity catalog Mandatory to run the LLM Chatbot With RAG, DBRX demo?

Hi! I am new to databricks. I was trying to run the RAG demo notebooks in databricks (@ Link to the demo: Deploy Your LLM Chatbot With Retrieval Augmented Generation (RAG), Foundation Models and Vector Search | Databricks), in which the 00-init noteb...

  • 1529 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Abhishek_blue, The error message you encountered, “[UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster,” indicates that the Unity Catalog feature is not enabled for your Databricks cluster. Let’s address your questions: Is enabling ...

  • 0 kudos
Gromduraz
by New Contributor II
  • 2690 Views
  • 2 replies
  • 0 kudos

Trouble Using Foundation Models API with Instructor

Hello,I'm attempting to use the instructor library for validating the output of a foundation model (DBRX in this case). Here's my code: import instructor from instructor.client import Instructor from pydantic import BaseModel from openai import OpenA...

  • 2690 Views
  • 2 replies
  • 0 kudos
Latest Reply
Gromduraz
New Contributor II
  • 0 kudos

Reviewing my posted code I should mention that the 'tool_choice' argument I'm passing is a default argument of the OpenAI client object. The code still breaks in the same way if I remove that argument from the function call. I think this is out of my...

  • 0 kudos
1 More Replies
Sujitha
by Community Manager
  • 5001 Views
  • 1 replies
  • 5 kudos

How to successfully build GenAI applications

The Big Book of Generative AI brings together best practices and know-how for building production-quality GenAI applications. You’ll find technical content and code samples that will help you do everything from deploying your first application to bui...

Screenshot 2024-04-23 at 8.10.12 AM.png
  • 5001 Views
  • 1 replies
  • 5 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 5 kudos

Thanks for sharing!

  • 5 kudos
pdiegop
by New Contributor II
  • 4082 Views
  • 5 replies
  • 1 kudos

Databricks Foundation Model APIs not present in the interface

The Foundation Model are not displayed in the Serving Endpoint pageAm I missing something?Thanks

provaprova_0-1706349999847.jpeg
  • 4082 Views
  • 5 replies
  • 1 kudos
Latest Reply
cmunteanu
Contributor
  • 1 kudos

Hello @pdiegop , seems that the option that we are looking for, which is: Foundation Model APIs (pay-per-token) is only available in certain regions. Check - out the Region availability table in this link. I am in the westeurope region, therefore, I ...

  • 1 kudos
4 More Replies
Sujitha
by Community Manager
  • 833 Views
  • 0 replies
  • 2 kudos

Share Your Thoughts on DBRX: We Want to Hear from You!

Hey there! We unveiled DBRX last Friday and we are eager to hear your thoughts! Did you catch the announcement? Drop a comment below and let us know what you think! Your feedback means the world to us. #DBRXFeedback

  • 833 Views
  • 0 replies
  • 2 kudos
ML2022
by New Contributor III
  • 3528 Views
  • 1 replies
  • 2 kudos

Seeking Advice: Extracting Text from Keynote and MP4 Files for RAG Implementation

Hello, everyone!I'm currently working on building a Retrieval-Augmented Generation (RAG) system, where the goal is to extract text from various document types (including PDFs, Excel files, HTML pages, text documents, Docs, PPTs, and notably, Keynote ...

  • 3528 Views
  • 1 replies
  • 2 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 2 kudos

Hi @ML2022, Building a Retrieval-Augmented Generation (RAG) system sounds like an exciting project! Let’s dive into your challenges with extracting text from Keynote files and MP4 video files: Keynote Files: Extracting textual content from Keyno...

  • 2 kudos
Sujitha
by Community Manager
  • 12964 Views
  • 2 replies
  • 1 kudos

Drive Value With Generative AI

Join us this March to see how generative AI can drive value. Build your own LLM trained on your data with Databricks’ new MPT model: Mosaic AI. Imagine if you could train and deploy your own LLM — customized with your own data that gives accurate res...

2024-01-The-Gen-AI-Payoff-in-2024-BRR-Ad-300x250-2x.png
  • 12964 Views
  • 2 replies
  • 1 kudos
Latest Reply
eniaos
New Contributor II
  • 1 kudos

Hi @Sujitha, thank you for the great initiative. Will the recording of the event be available afterwards?

  • 1 kudos
1 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 25033 Views
  • 3 replies
  • 5 kudos

Resolved! SQL AI functions

Recently, many AI SQL functions have been added to databricks. They are using the foundation model API and currently Mixtral-8x7B Instruct.Which one is your favourite one? Do you have ideas for another such function?

sqlai8.png sqlai7.png sqlai6.png sqlai5.png
  • 25033 Views
  • 3 replies
  • 5 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 5 kudos

Hi @Hubert-Dudek, Thank you for sharing this exciting update about the new AI SQL functions added to Databricks, utilizing the foundation model API, particularly the Mixtral-8x7B Instruct model. It's great to see how Databricks continues to innovate ...

  • 5 kudos
2 More Replies
Mathew
by New Contributor
  • 10174 Views
  • 1 replies
  • 0 kudos

How can I utilize multiple GPUs from multiple nodes in Databricks

I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...

  • 10174 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Mathew , Leveraging multiple GPUs for batchwise inference with the Whisper model on Databricks can significantly enhance performance. While the Whisper model typically uses a single GPU, there’s a workaround to utilize multiple GPUs—one for the e...

  • 0 kudos
raduq
by Contributor
  • 16632 Views
  • 1 replies
  • 1 kudos

Resolved! Why does the Generative AI Engineering Pathway not available?

I just saw the Databricks announcement on Twitter about the launch of the GenAI Engineer Pathway certification and I wanted to start learning.https://twitter.com/databricks/status/1756721509224108353But when logging into the Academy, they are all loc...

raduq_0-1707728005134.png
  • 16632 Views
  • 1 replies
  • 1 kudos
Latest Reply
raduq
Contributor
  • 1 kudos

I'm a bit of a noob with the Academy interface, found the way to enroll. We actually have to search the catalog for the course and then if you find it from there, you can select it from the list and an "Enroll" button will appear and allow you to sta...

  • 1 kudos
Sujitha
by Community Manager
  • 13416 Views
  • 1 replies
  • 0 kudos

Boost your data & AI skills with our latest offerings: Databricks Academy Labs and Blended Learning

From the data + AI experts, today, we're announcing two unique ways that practitioners can leverage leading-edge technologies – Databricks Academy Labs and Blended Learning. Databricks Academy Labs are on-demand, hands-on guided lab experiences in Da...

Screenshot 2024-01-16 at 10.21.22 AM.png
  • 13416 Views
  • 1 replies
  • 0 kudos
Latest Reply
jose_gonzalez
Moderator
  • 0 kudos

Thank you for sharing

  • 0 kudos