cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Community Manager
  • 6996 Views
  • 3 replies
  • 8 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 6996 Views
  • 3 replies
  • 8 kudos
Latest Reply
Danny_Lee
Contributor III
  • 8 kudos

Just completed the 2nd course, Generative AI Engineering with Databricks and it was excellent.  There's so much content to explore it's worth going over twice.

  • 8 kudos
2 More Replies
mayank_gupta
by New Contributor
  • 31 Views
  • 1 replies
  • 0 kudos

Not able to use tool type role with DBRX endpoint

Error code: 404 - {'error_code': 'FEATURE_DISABLED', 'message': 'FEATURE_DISABLED: Tool Calling is not enabled for this workspace'}Receiving this error when trying to complete chat using tools. How to enable Features?I am posting for the first time. ...

Generative AI
DBRX
model endpoint
  • 31 Views
  • 1 replies
  • 0 kudos
Latest Reply
NandiniN
Valued Contributor III
  • 0 kudos

Hi @mayank_gupta , I checked internally on this. The endpoints need to support this capability. It seems likely that our model serving framework would need to accommodate tool calling. I will ask the concerned team to check on this.  Thanks!

  • 0 kudos
jbellidocaceres
by New Contributor II
  • 261 Views
  • 2 replies
  • 2 kudos

can't run the agent-studio RAG DBRX chatbot example

Hi,  I have apparently successfully the deployed the agent-studio RAG DBRX and  chatbot example from:https://github.com/rmosleydb/agent-studioHowever, when entering a question in the chatbot box, I get an error message. The  error says that it can't ...

  • 261 Views
  • 2 replies
  • 2 kudos
Latest Reply
jbellidocaceres
New Contributor II
  • 2 kudos

Hi @Kaniz ,  thank you for the hints. I will give a closer look to the  input schema and the Vector Search endpoint.

  • 2 kudos
1 More Replies
Amit_Dass_Chmp
by New Contributor II
  • 133 Views
  • 1 replies
  • 0 kudos

How we can choose the right LLM model, also considering the cost.

Hi All, I understand we are in the evaluation journey where we have 100+ LLMs (Open or Proprietary models ), but please guide us on how we can choose the right LLM model, also considering the cost. Do we have any benchmark to follow considering the u...

  • 133 Views
  • 1 replies
  • 0 kudos
Latest Reply
mhiltner
New Contributor II
  • 0 kudos

Hey! It depends a lot on your application. Different LLMs excel in different functions. Proprietary models will be more expensive then Open Source ones, but they will likely lead you to a faster time to production with your applications.  Also, if yo...

  • 0 kudos
Abhishek_blue
by New Contributor
  • 464 Views
  • 1 replies
  • 0 kudos

Is enabling Unity catalog Mandatory to run the LLM Chatbot With RAG, DBRX demo?

Hi! I am new to databricks. I was trying to run the RAG demo notebooks in databricks (@ Link to the demo: Deploy Your LLM Chatbot With Retrieval Augmented Generation (RAG), Foundation Models and Vector Search | Databricks), in which the 00-init noteb...

  • 464 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Abhishek_blue, The error message you encountered, “[UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster,” indicates that the Unity Catalog feature is not enabled for your Databricks cluster. Let’s address your questions: Is enabling ...

  • 0 kudos
Gromduraz
by New Contributor II
  • 690 Views
  • 2 replies
  • 0 kudos

Trouble Using Foundation Models API with Instructor

Hello,I'm attempting to use the instructor library for validating the output of a foundation model (DBRX in this case). Here's my code: import instructor from instructor.client import Instructor from pydantic import BaseModel from openai import OpenA...

  • 690 Views
  • 2 replies
  • 0 kudos
Latest Reply
Gromduraz
New Contributor II
  • 0 kudos

Reviewing my posted code I should mention that the 'tool_choice' argument I'm passing is a default argument of the OpenAI client object. The code still breaks in the same way if I remove that argument from the function call. I think this is out of my...

  • 0 kudos
1 More Replies
Sujitha
by Community Manager
  • 2518 Views
  • 1 replies
  • 5 kudos

How to successfully build GenAI applications

The Big Book of Generative AI brings together best practices and know-how for building production-quality GenAI applications. You’ll find technical content and code samples that will help you do everything from deploying your first application to bui...

Screenshot 2024-04-23 at 8.10.12 AM.png
  • 2518 Views
  • 1 replies
  • 5 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 5 kudos

Thanks for sharing!

  • 5 kudos
pdiegop
by New Contributor II
  • 1925 Views
  • 5 replies
  • 1 kudos

Databricks Foundation Model APIs not present in the interface

The Foundation Model are not displayed in the Serving Endpoint pageAm I missing something?Thanks

provaprova_0-1706349999847.jpeg
  • 1925 Views
  • 5 replies
  • 1 kudos
Latest Reply
cmunteanu
New Contributor III
  • 1 kudos

Hello @pdiegop , seems that the option that we are looking for, which is: Foundation Model APIs (pay-per-token) is only available in certain regions. Check - out the Region availability table in this link. I am in the westeurope region, therefore, I ...

  • 1 kudos
4 More Replies
Sujitha
by Community Manager
  • 335 Views
  • 0 replies
  • 2 kudos

Share Your Thoughts on DBRX: We Want to Hear from You!

Hey there! We unveiled DBRX last Friday and we are eager to hear your thoughts! Did you catch the announcement? Drop a comment below and let us know what you think! Your feedback means the world to us. #DBRXFeedback

  • 335 Views
  • 0 replies
  • 2 kudos
cmunteanu
by New Contributor III
  • 1539 Views
  • 2 replies
  • 1 kudos

Resolved! Dbdemo: LLM Chatbot With Retrieval Augmented Generation (RAG)

Hello All,I am trying to follow the dbdemo called 'llm-rag-chatbot' available at the following link. The setup works Ok, and I have imported from the Databricks Marketplace an embedding model that is:bge_large_en_v1_5Running the notebook called: 01-D...

  • 1539 Views
  • 2 replies
  • 1 kudos
Latest Reply
cmunteanu
New Contributor III
  • 1 kudos

Hello @Kaniz , thanks a lot for the information you provided. Anyhow, I have managed a workaround, by pre-computing the embeddings for each chunk.  I have created an embedding column on the source table and used this column as input to the create_del...

  • 1 kudos
1 More Replies
ML2022
by New Contributor III
  • 1217 Views
  • 1 replies
  • 2 kudos

Seeking Advice: Extracting Text from Keynote and MP4 Files for RAG Implementation

Hello, everyone!I'm currently working on building a Retrieval-Augmented Generation (RAG) system, where the goal is to extract text from various document types (including PDFs, Excel files, HTML pages, text documents, Docs, PPTs, and notably, Keynote ...

  • 1217 Views
  • 1 replies
  • 2 kudos
Latest Reply
Kaniz
Community Manager
  • 2 kudos

Hi @ML2022, Building a Retrieval-Augmented Generation (RAG) system sounds like an exciting project! Let’s dive into your challenges with extracting text from Keynote files and MP4 video files: Keynote Files: Extracting textual content from Keyno...

  • 2 kudos
Sujitha
by Community Manager
  • 4889 Views
  • 2 replies
  • 1 kudos

Drive Value With Generative AI

Join us this March to see how generative AI can drive value. Build your own LLM trained on your data with Databricks’ new MPT model: Mosaic AI. Imagine if you could train and deploy your own LLM — customized with your own data that gives accurate res...

2024-01-The-Gen-AI-Payoff-in-2024-BRR-Ad-300x250-2x.png
  • 4889 Views
  • 2 replies
  • 1 kudos
Latest Reply
eniaos
New Contributor II
  • 1 kudos

Hi @Sujitha, thank you for the great initiative. Will the recording of the event be available afterwards?

  • 1 kudos
1 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 6265 Views
  • 3 replies
  • 5 kudos

Resolved! SQL AI functions

Recently, many AI SQL functions have been added to databricks. They are using the foundation model API and currently Mixtral-8x7B Instruct.Which one is your favourite one? Do you have ideas for another such function?

sqlai8.png sqlai7.png sqlai6.png sqlai5.png
  • 6265 Views
  • 3 replies
  • 5 kudos
Latest Reply
Kaniz
Community Manager
  • 5 kudos

Hi @Hubert-Dudek, Thank you for sharing this exciting update about the new AI SQL functions added to Databricks, utilizing the foundation model API, particularly the Mixtral-8x7B Instruct model. It's great to see how Databricks continues to innovate ...

  • 5 kudos
2 More Replies
Mathew
by New Contributor
  • 2620 Views
  • 1 replies
  • 0 kudos

How can I utilize multiple GPUs from multiple nodes in Databricks

I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...

  • 2620 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Mathew , Leveraging multiple GPUs for batchwise inference with the Whisper model on Databricks can significantly enhance performance. While the Whisper model typically uses a single GPU, there’s a workaround to utilize multiple GPUs—one for the e...

  • 0 kudos
Sujitha
by Community Manager
  • 6996 Views
  • 3 replies
  • 8 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 6996 Views
  • 3 replies
  • 8 kudos
Latest Reply
Danny_Lee
Contributor III
  • 8 kudos

Just completed the 2nd course, Generative AI Engineering with Databricks and it was excellent.  There's so much content to explore it's worth going over twice.

  • 8 kudos
2 More Replies
raduq
by Contributor
  • 1935 Views
  • 1 replies
  • 1 kudos

Resolved! Why does the Generative AI Engineering Pathway not available?

I just saw the Databricks announcement on Twitter about the launch of the GenAI Engineer Pathway certification and I wanted to start learning.https://twitter.com/databricks/status/1756721509224108353But when logging into the Academy, they are all loc...

raduq_0-1707728005134.png
  • 1935 Views
  • 1 replies
  • 1 kudos
Latest Reply
raduq
Contributor
  • 1 kudos

I'm a bit of a noob with the Academy interface, found the way to enroll. We actually have to search the catalog for the course and then if you find it from there, you can select it from the list and an "Enroll" button will appear and allow you to sta...

  • 1 kudos