- 30811 Views
- 19 replies
- 34 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 30811 Views
- 19 replies
- 34 kudos
- 34 kudos
This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha
- 34 kudos
- 194 Views
- 1 replies
- 0 kudos
Run Genie in multi-agent systems
I am trying the notebook to run Genie space in multi agent system, following:https://docs.databricks.com/aws/en/generative-ai/agent-framework/multi-agent-genie#gsc.tab=0Also there is a YouTube vide discussing about this: https://www.youtube.com/watch...
- 194 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @chenmx , The first link you provided is the latest example code that Databricks provides for setting up a multi-agent supervisor with a genie space, the exact same code as the youtube video is not published. Would you be able to share some more d...
- 0 kudos
- 172 Views
- 1 replies
- 0 kudos
pop up when using databrics sql
Hello, I am uning databricks sql to read from a unity catalog table locally on a python project using an azure sp client id and client secretthe connexion is successful however i have a pop up that asks me to connect to my azure envis there a way to ...
- 172 Views
- 1 replies
- 0 kudos
- 0 kudos
In your .env file, add: DATABRICKS_WORKSPACE_RESOURCE_ID=/subscriptions/your-sub-id/resourceGroups/your-rg/providers/Microsoft.Databricks/workspaces/your -workspace Alternative approaches if the popup persists: 1. Use OAuth machine-to-m...
- 0 kudos
- 675 Views
- 3 replies
- 0 kudos
Resolved! Testing out Agentic Capabilities
So I am creating a POV on Databricks' agentic capabilities and wanted to showcase its abilities through a simple change pipeline.A user asks for changes in a specific table in a schema -> based on metadata info from our lake table info is received ->...
- 675 Views
- 3 replies
- 0 kudos
- 0 kudos
Yes, it’s viable — Databricks’ in-house agents can handle that workflow if you define each stage as callable Python tools. The key is robust function design and proper metadata access. However, you might find integrating Unity Catalog and Git integra...
- 0 kudos
- 247 Views
- 2 replies
- 2 kudos
Load the HF pipeline in databricks
Hi all, I have a question about the integration of HF in Databricks.I'm struggling to save the models and datasets:For instance, for the code below, I got this error:ValueError: Could not load model nickwong64/bert-base-uncased-poems-sentiment with a...
- 247 Views
- 2 replies
- 2 kudos
- 2 kudos
The error happens because the model "nickwong64/bert-base-uncased-poems-sentiment" isn’t correctly registered as a SequenceClassification model in Hugging Face. You can try:Use AutoModelForSequenceClassification explicitly: from transformers import...
- 2 kudos
- 4167 Views
- 3 replies
- 1 kudos
I am struggling on complicated RAG code for Mosaic evaluation deployment
I want to know how I can apply some complicated RAG designs so I can directly deploy on the Mosaic AI evaluation UI. There are two cases:1. two or more index retrieval as independent tools (parallel retrievals)2.two index retrieval processes that dep...
- 4167 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @wind2025, for Mosaic RAG setups:Parallel retrievals: independent retrievers feeding one or multiple LLMs.Linear retrievals: chain retrievers so output of one filters the next.Independent RAG chains: define separate chains and register both as too...
- 1 kudos
- 637 Views
- 1 replies
- 1 kudos
Function Calling and Tool Integration: Empowering Agents to Take Action
Function calling is what truly unlocks an agent’s potential on Databricks. It’s the bridge between conversation and action — turning an LLM from a chatty assistant into an autonomous system that actually gets stuff done. Imagine this: an agent that c...
- 637 Views
- 1 replies
- 1 kudos
- 1 kudos
To strike the right balance, I’d focus on modular, well-documented tools with strict access control. Each callable function should have:Clear purpose & description – so the LLM knows when to invoke it.Input/output validation – prevents unintended act...
- 1 kudos
- 6420 Views
- 3 replies
- 0 kudos
How can we serve Genie as an endpoint model like RAG?
Is there any way to serve genie bot as a endpoint model like we serve RAG models. So we can access the genie bot outside the genie space?
- 6420 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @hammad, you can use AgentBricks - Multi Agent Supervisor to achieve the same result. You also use Genie as a Databricks-managed MCP tool. Depending on your situation, you can choose the option that suits you best.
- 0 kudos
- 3998 Views
- 1 replies
- 1 kudos
Resolved! Exception: The demo llm-rag-chatbot doesn't exist.
Hello,when I try to bring the demo environment (LLM Chatbot With Retrieval Augmented Generation (RAG) and DBRX) into my Databricks workspace, I get the following error: Exception: The demo llm-rag-chatbot doesn't exist.I execute the following code: %...
- 3998 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @xiinex - You are right. This demo is now deprecated. Please use the ai-agent demo.
- 1 kudos
- 816 Views
- 5 replies
- 1 kudos
Resolved! Problems with unstructured_data_pipeline
Hi everyone,I'm currently working with the unstructured data pipeline in Databricks, using the official notebook provided by Databricks without any modifications. Strangely, despite being an out-of-the-box resource, the notebook fails during executio...
- 816 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi @Mariano-Vertiz - Which access mode are you using for your cluster - dedicated or standard? I think it is failing as a standard cluster does not allow the low-level operation it is trying to perform in cell 42. Is that where it's failing? I tried ...
- 1 kudos
- 4692 Views
- 1 replies
- 1 kudos
Resolved! Error when logging artifact OSError: [Errno 5] Input/output error: '/dbfs/Volumes'
Hi, I'm building an streamlit application on databricks apps, where user can upload some data , and I run an LLM model and return results. There, I want to log an artifact to a volume. I'm following this documentation https://docs.databricks.com/aws...
- 4692 Views
- 1 replies
- 1 kudos
- 1 kudos
The error text OSError: [Errno 5] Input/output error: '/dbfs/Volumes' occurs because Databricks Apps (including Streamlit apps running on Databricks) currently do not have direct write access to /dbfs/Volumes for artifact logging via M...
- 1 kudos
- 1463 Views
- 9 replies
- 2 kudos
getting 500 on embedding model invocation call
I'm getting the following error message "{"error_code": "INTERNAL_ERROR", "message": "The server received an invalid response from an upstream server."}" when making a call to bge-large-en embedding model.
- 1463 Views
- 9 replies
- 2 kudos
- 2 kudos
Hi @tefrati - Can you please go to the model serving endpoint and click on the use drop down (as shown in the picture below) and try the simple python or sql and see if that works for you. from openai import OpenAI import os # How to get your Databr...
- 2 kudos
- 420 Views
- 2 replies
- 0 kudos
Multilingual embedding foundation model request
Are there any plans to offer a foundation model with multilingual support? Llama embed nemotron 8b or qwen3-embedding 8b would help out a lot for users that do not only process data in the English language.
- 420 Views
- 2 replies
- 0 kudos
- 0 kudos
Sorry I wasn't clear enough in my question: I mean embedding models specifically.
- 0 kudos
- 1326 Views
- 1 replies
- 1 kudos
Permission Denied for Genie Auto-Generated Service Principal on SQL Endpoint in Playground
Hi community,Use Genie in multi-agent systems | Databricks DocumentationI’ve developed a multi-agent Genie in Databricks and integrated it with vector indexes. The setup works fine during model logging and prediction. The system successfully register...
- 1326 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Karthik_Karanm - Can you ensure to add the Genie in the resources as mentioned in the TODO of the cell. To enable automatic authentication, specify the dependent Databricks resources when calling mlflow.pyfunc.log_model(). TODO: If your Unity Ca...
- 1 kudos
- 745 Views
- 2 replies
- 0 kudos
Utilizing Genie AI with Workflows
As subject says, is this possible via creating a python script that calls agent.predict etc...? Similar to thisagent.predict( { "messages": [{"role": "user", "content": "...the question we want to ask Genie..."}], } )I want to implement Genie AI, and...
- 745 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @stexil, you can achieve this by using Genie as an agent in a multi-agent system. If you prefer to use code then follow this - https://docs.databricks.com/aws/en/generative-ai/agent-framework/multi-agent-genie#gsc.tab=0. If you want to use point a...
- 0 kudos
- 1366 Views
- 2 replies
- 2 kudos
Resolved! Model serving endpoint API error - Mosaic AI Agents API
Hi, I have built a Chatbot App using Streamlit (through Databricks Apps UI). The chatbot backend is a custom RAG model which is built by following this example notebook: 02-Deploy-RAG-Chatbot-Model.The needed databricks packages are installed: databr...
- 1366 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @JingXie, This is a classic authentication token issue, but it's happening in a different place than you might think. The Invalid Token error is not coming from your Streamlit App's call to your chatbot_poc endpoint. It's coming from inside your c...
- 2 kudos
