cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Community Manager
  • 7269 Views
  • 3 replies
  • 8 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 7269 Views
  • 3 replies
  • 8 kudos
Latest Reply
Danny_Lee
Contributor III
  • 8 kudos

Just completed the 2nd course, Generative AI Engineering with Databricks and it was excellent.  There's so much content to explore it's worth going over twice.

  • 8 kudos
2 More Replies
mayank_gupta
by New Contributor
  • 590 Views
  • 6 replies
  • 1 kudos

Not able to use tool type role with DBRX endpoint

Error code: 404 - {'error_code': 'FEATURE_DISABLED', 'message': 'FEATURE_DISABLED: Tool Calling is not enabled for this workspace'}Receiving this error when trying to complete chat using tools. How to enable tool calling feature?I am posting for the ...

Generative AI
DBRX
model endpoint
  • 590 Views
  • 6 replies
  • 1 kudos
Latest Reply
NandiniN
Valued Contributor III
  • 1 kudos

Hi @mayank_gupta @rpunuru , I could not get more information on the exact cause, but here are a few more pointers to check  - Are you trying from an unsupported region for External models?https://learn.microsoft.com/en-us/azure/databricks/machine-lea...

  • 1 kudos
5 More Replies
sarenity
by New Contributor
  • 132 Views
  • 3 replies
  • 0 kudos

Can't use tool type role with DBRX

Error code: 404 - {'error_code': 'FEATURE_DISABLED', 'message': 'FEATURE_DISABLED: Tool Calling is not enabled for this workspace'}Receiving this error when trying to complete chat using tools. How to enable tool calling feature?I am posting for the ...

  • 132 Views
  • 3 replies
  • 0 kudos
Latest Reply
NandiniN
Valued Contributor III
  • 0 kudos

Hi, Just a passer-by comment. Not sure if the same question is asked here, linking the two for ease. I could not get more information on the exact cause, but here are a few more pointers to check  - Are you trying from an unsupported region for Exter...

  • 0 kudos
2 More Replies
cmunteanu
by New Contributor III
  • 1794 Views
  • 3 replies
  • 2 kudos

Resolved! Dbdemo: LLM Chatbot With Retrieval Augmented Generation (RAG)

Hello All,I am trying to follow the dbdemo called 'llm-rag-chatbot' available at the following link. The setup works Ok, and I have imported from the Databricks Marketplace an embedding model that is:bge_large_en_v1_5Running the notebook called: 01-D...

  • 1794 Views
  • 3 replies
  • 2 kudos
Latest Reply
jbellidocaceres
New Contributor II
  • 2 kudos

Hi  @Kaniz  and  @cmunteanu  , I am having exactly the same problem to create the vector index and it seems that there could be a bug in the demo. What confuses me is that and even when using the Databricks UI, I can not manage to create the vector i...

  • 2 kudos
2 More Replies
jbellidocaceres
by New Contributor II
  • 553 Views
  • 2 replies
  • 2 kudos

can't run the agent-studio RAG DBRX chatbot example

Hi,  I have apparently successfully the deployed the agent-studio RAG DBRX and  chatbot example from:https://github.com/rmosleydb/agent-studioHowever, when entering a question in the chatbot box, I get an error message. The  error says that it can't ...

  • 553 Views
  • 2 replies
  • 2 kudos
Latest Reply
jbellidocaceres
New Contributor II
  • 2 kudos

Hi @Kaniz ,  thank you for the hints. I will give a closer look to the  input schema and the Vector Search endpoint.

  • 2 kudos
1 More Replies
Amit_Dass_Chmp
by New Contributor II
  • 237 Views
  • 1 replies
  • 0 kudos

How we can choose the right LLM model, also considering the cost.

Hi All, I understand we are in the evaluation journey where we have 100+ LLMs (Open or Proprietary models ), but please guide us on how we can choose the right LLM model, also considering the cost. Do we have any benchmark to follow considering the u...

  • 237 Views
  • 1 replies
  • 0 kudos
Latest Reply
mhiltner
New Contributor III
  • 0 kudos

Hey! It depends a lot on your application. Different LLMs excel in different functions. Proprietary models will be more expensive then Open Source ones, but they will likely lead you to a faster time to production with your applications.  Also, if yo...

  • 0 kudos
Abhishek_blue
by New Contributor
  • 528 Views
  • 1 replies
  • 0 kudos

Is enabling Unity catalog Mandatory to run the LLM Chatbot With RAG, DBRX demo?

Hi! I am new to databricks. I was trying to run the RAG demo notebooks in databricks (@ Link to the demo: Deploy Your LLM Chatbot With Retrieval Augmented Generation (RAG), Foundation Models and Vector Search | Databricks), in which the 00-init noteb...

  • 528 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Abhishek_blue, The error message you encountered, “[UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster,” indicates that the Unity Catalog feature is not enabled for your Databricks cluster. Let’s address your questions: Is enabling ...

  • 0 kudos
Gromduraz
by New Contributor II
  • 746 Views
  • 2 replies
  • 0 kudos

Trouble Using Foundation Models API with Instructor

Hello,I'm attempting to use the instructor library for validating the output of a foundation model (DBRX in this case). Here's my code: import instructor from instructor.client import Instructor from pydantic import BaseModel from openai import OpenA...

  • 746 Views
  • 2 replies
  • 0 kudos
Latest Reply
Gromduraz
New Contributor II
  • 0 kudos

Reviewing my posted code I should mention that the 'tool_choice' argument I'm passing is a default argument of the OpenAI client object. The code still breaks in the same way if I remove that argument from the function call. I think this is out of my...

  • 0 kudos
1 More Replies
Sujitha
by Community Manager
  • 2873 Views
  • 1 replies
  • 5 kudos

How to successfully build GenAI applications

The Big Book of Generative AI brings together best practices and know-how for building production-quality GenAI applications. You’ll find technical content and code samples that will help you do everything from deploying your first application to bui...

Screenshot 2024-04-23 at 8.10.12 AM.png
  • 2873 Views
  • 1 replies
  • 5 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 5 kudos

Thanks for sharing!

  • 5 kudos
pdiegop
by New Contributor II
  • 2018 Views
  • 5 replies
  • 1 kudos

Databricks Foundation Model APIs not present in the interface

The Foundation Model are not displayed in the Serving Endpoint pageAm I missing something?Thanks

provaprova_0-1706349999847.jpeg
  • 2018 Views
  • 5 replies
  • 1 kudos
Latest Reply
cmunteanu
New Contributor III
  • 1 kudos

Hello @pdiegop , seems that the option that we are looking for, which is: Foundation Model APIs (pay-per-token) is only available in certain regions. Check - out the Region availability table in this link. I am in the westeurope region, therefore, I ...

  • 1 kudos
4 More Replies
Sujitha
by Community Manager
  • 359 Views
  • 0 replies
  • 2 kudos

Share Your Thoughts on DBRX: We Want to Hear from You!

Hey there! We unveiled DBRX last Friday and we are eager to hear your thoughts! Did you catch the announcement? Drop a comment below and let us know what you think! Your feedback means the world to us. #DBRXFeedback

  • 359 Views
  • 0 replies
  • 2 kudos
ML2022
by New Contributor III
  • 1338 Views
  • 1 replies
  • 2 kudos

Seeking Advice: Extracting Text from Keynote and MP4 Files for RAG Implementation

Hello, everyone!I'm currently working on building a Retrieval-Augmented Generation (RAG) system, where the goal is to extract text from various document types (including PDFs, Excel files, HTML pages, text documents, Docs, PPTs, and notably, Keynote ...

  • 1338 Views
  • 1 replies
  • 2 kudos
Latest Reply
Kaniz
Community Manager
  • 2 kudos

Hi @ML2022, Building a Retrieval-Augmented Generation (RAG) system sounds like an exciting project! Let’s dive into your challenges with extracting text from Keynote files and MP4 video files: Keynote Files: Extracting textual content from Keyno...

  • 2 kudos
Sujitha
by Community Manager
  • 5029 Views
  • 2 replies
  • 1 kudos

Drive Value With Generative AI

Join us this March to see how generative AI can drive value. Build your own LLM trained on your data with Databricks’ new MPT model: Mosaic AI. Imagine if you could train and deploy your own LLM — customized with your own data that gives accurate res...

2024-01-The-Gen-AI-Payoff-in-2024-BRR-Ad-300x250-2x.png
  • 5029 Views
  • 2 replies
  • 1 kudos
Latest Reply
eniaos
New Contributor II
  • 1 kudos

Hi @Sujitha, thank you for the great initiative. Will the recording of the event be available afterwards?

  • 1 kudos
1 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 7640 Views
  • 3 replies
  • 5 kudos

Resolved! SQL AI functions

Recently, many AI SQL functions have been added to databricks. They are using the foundation model API and currently Mixtral-8x7B Instruct.Which one is your favourite one? Do you have ideas for another such function?

sqlai8.png sqlai7.png sqlai6.png sqlai5.png
  • 7640 Views
  • 3 replies
  • 5 kudos
Latest Reply
Kaniz
Community Manager
  • 5 kudos

Hi @Hubert-Dudek, Thank you for sharing this exciting update about the new AI SQL functions added to Databricks, utilizing the foundation model API, particularly the Mixtral-8x7B Instruct model. It's great to see how Databricks continues to innovate ...

  • 5 kudos
2 More Replies
Mathew
by New Contributor
  • 2903 Views
  • 1 replies
  • 0 kudos

How can I utilize multiple GPUs from multiple nodes in Databricks

I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...

  • 2903 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Mathew , Leveraging multiple GPUs for batchwise inference with the Whisper model on Databricks can significantly enhance performance. While the Whisper model typically uses a single GPU, there’s a workaround to utilize multiple GPUs—one for the e...

  • 0 kudos
Sujitha
by Community Manager
  • 7269 Views
  • 3 replies
  • 8 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 7269 Views
  • 3 replies
  • 8 kudos
Latest Reply
Danny_Lee
Contributor III
  • 8 kudos

Just completed the 2nd course, Generative AI Engineering with Databricks and it was excellent.  There's so much content to explore it's worth going over twice.

  • 8 kudos
2 More Replies