- 29994 Views
- 18 replies
- 33 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 29994 Views
- 18 replies
- 33 kudos
- 194 Views
- 3 replies
- 1 kudos
Resolved! Agentic AI Workload Analyzer
Hello Databricks experts,In Automating Best Practices with Agentic AI Workload Analyzer, Krishna Satyavarapu and Nikhil Mishra mentioned "The Agentic AI Workload Analyzer". Is it known when this will be available.cheersMario
- 194 Views
- 3 replies
- 1 kudos
- 1 kudos
Generative AI is transforming how we handle data and automation. The key challenge now is balancing model creativity with control — ensuring reliable outputs while keeping innovation at the core.
- 1 kudos
- 4418 Views
- 1 replies
- 1 kudos
Accessing UC Volumes using pure python (ML) with databricks-connect
Hi All,In my organization, we use Databricks Connect and VS Code for data engineering purposes. This setup is working great, especially for:- Debugging- Unit tests- GitHub Copilot- Reusable modules and custom librariesIn my view, the developer experi...
- 4418 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey @KrzysztofPrzyso , so sorry this question got lost in the shuffle. This is a known architectural limitation with Databricks Connect when working with pure Python file operations and UC Volumes. The issue stems from how Databricks Connect executes...
- 1 kudos
- 3696 Views
- 1 replies
- 1 kudos
AI_QUERY fails with o1-mini
As of sometime between March 7th and March 12, the AI_QUERY function has become very temperamental with Azure OpenAI models.Asking a basic question of our Mosaic AI o1-mini serving endpoint using AI_QUERY causes an error sometimes but not every time:...
- 3696 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @jAAmes_bentley , I did some digging and here is what I found. Root Cause: Unsupported Temperature Parameter The primary issue with your `AI_QUERY` call to o1-mini is the temperature parameter. OpenAI's o1-series models (o1, o1-mini, o1-preview...
- 1 kudos
- 175 Views
- 2 replies
- 0 kudos
Issue while implementation of Use Genie in multi-agent systems
I am testing https://docs.databricks.com/aws/en/generative-ai/agent-framework/multi-agent-genie and looks code is not up to date and it is failing as longchain version upgraded to v1 from v0 that does not support post_model_hook parameter.I tried mul...
- 175 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Ajay, it looks like the Databricks multi-agent Genie docs haven’t been updated for langchain v1. You’ll need to remove or replace the post_model_hook parameter with the new callback or event handling mechanisms in v1. Checking the latest langchain...
- 0 kudos
- 629 Views
- 12 replies
- 3 kudos
AgentBricks - Multi Agent Supervisor Issue
Hi, I am doing POC using AgentBricks and using Multi Agent Supervisor. I have configured 2 subagents.1. Genie Space2. UC Function to call LLM3. UC Function to plot chartsHowever, the agent is able to access and use only Genie space agent and not usin...
- 629 Views
- 12 replies
- 3 kudos
- 3 kudos
Also, as you can see on the top right of the attached image, it creates an MLFlow experiment. Click on that MLflow experiment, and check the traces and let me know what it shows, as you can see here it shows the tool is being called in the trace. ...
- 3 kudos
- 2743 Views
- 1 replies
- 0 kudos
Libraries in requirements file not installed when streamlit app is deployed
I deployed a streamlit app on Databricks cluster but the libraries in the requirments.txt file were not installed when the app is deployed. I'm getting this error when a function that uses OpenAI is called."ImportError: Could not import openai python...
- 2743 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @data_scientist3 , Would you share how you deployed the Streamlit app (Databricks Apps vs running Streamlit from a notebook/job cluster) and your cluster’s Databricks Runtime version? That’ll help me tailor the exact steps to your setup. Option 1:...
- 0 kudos
- 14593 Views
- 1 replies
- 1 kudos
Genie Space
Hi Team,I would like to use Genie to enable NLP on my delta lake. However, the documentation mention the limitation as 20 messages per minute for a workspace for all Genie Spaces.Is there a pay-as-go model for Genie Space?Regards,Ravi Kumar Singh
- 14593 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @RaviSingh0000 , 20 messages per minute per workspace across all the spaces is a throughput that Genie currently offers. What is the throughput requirement you have per workspace? It doesn't have a pay-as-you-go model. Currently, it is charged for...
- 1 kudos
- 114 Views
- 1 replies
- 0 kudos
Run Genie in multi-agent systems
I am trying the notebook to run Genie space in multi agent system, following:https://docs.databricks.com/aws/en/generative-ai/agent-framework/multi-agent-genie#gsc.tab=0Also there is a YouTube vide discussing about this: https://www.youtube.com/watch...
- 114 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @chenmx , The first link you provided is the latest example code that Databricks provides for setting up a multi-agent supervisor with a genie space, the exact same code as the youtube video is not published. Would you be able to share some more d...
- 0 kudos
- 88 Views
- 1 replies
- 0 kudos
pop up when using databrics sql
Hello, I am uning databricks sql to read from a unity catalog table locally on a python project using an azure sp client id and client secretthe connexion is successful however i have a pop up that asks me to connect to my azure envis there a way to ...
- 88 Views
- 1 replies
- 0 kudos
- 0 kudos
In your .env file, add: DATABRICKS_WORKSPACE_RESOURCE_ID=/subscriptions/your-sub-id/resourceGroups/your-rg/providers/Microsoft.Databricks/workspaces/your -workspace Alternative approaches if the popup persists: 1. Use OAuth machine-to-m...
- 0 kudos
- 459 Views
- 3 replies
- 0 kudos
Resolved! Testing out Agentic Capabilities
So I am creating a POV on Databricks' agentic capabilities and wanted to showcase its abilities through a simple change pipeline.A user asks for changes in a specific table in a schema -> based on metadata info from our lake table info is received ->...
- 459 Views
- 3 replies
- 0 kudos
- 0 kudos
Yes, it’s viable — Databricks’ in-house agents can handle that workflow if you define each stage as callable Python tools. The key is robust function design and proper metadata access. However, you might find integrating Unity Catalog and Git integra...
- 0 kudos
- 132 Views
- 2 replies
- 2 kudos
Load the HF pipeline in databricks
Hi all, I have a question about the integration of HF in Databricks.I'm struggling to save the models and datasets:For instance, for the code below, I got this error:ValueError: Could not load model nickwong64/bert-base-uncased-poems-sentiment with a...
- 132 Views
- 2 replies
- 2 kudos
- 2 kudos
The error happens because the model "nickwong64/bert-base-uncased-poems-sentiment" isn’t correctly registered as a SequenceClassification model in Hugging Face. You can try:Use AutoModelForSequenceClassification explicitly: from transformers import...
- 2 kudos
- 3868 Views
- 3 replies
- 1 kudos
I am struggling on complicated RAG code for Mosaic evaluation deployment
I want to know how I can apply some complicated RAG designs so I can directly deploy on the Mosaic AI evaluation UI. There are two cases:1. two or more index retrieval as independent tools (parallel retrievals)2.two index retrieval processes that dep...
- 3868 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @wind2025, for Mosaic RAG setups:Parallel retrievals: independent retrievers feeding one or multiple LLMs.Linear retrievals: chain retrievers so output of one filters the next.Independent RAG chains: define separate chains and register both as too...
- 1 kudos
- 436 Views
- 1 replies
- 1 kudos
Function Calling and Tool Integration: Empowering Agents to Take Action
Function calling is what truly unlocks an agent’s potential on Databricks. It’s the bridge between conversation and action — turning an LLM from a chatty assistant into an autonomous system that actually gets stuff done. Imagine this: an agent that c...
- 436 Views
- 1 replies
- 1 kudos
- 1 kudos
To strike the right balance, I’d focus on modular, well-documented tools with strict access control. Each callable function should have:Clear purpose & description – so the LLM knows when to invoke it.Input/output validation – prevents unintended act...
- 1 kudos
- 5997 Views
- 3 replies
- 0 kudos
How can we serve Genie as an endpoint model like RAG?
Is there any way to serve genie bot as a endpoint model like we serve RAG models. So we can access the genie bot outside the genie space?
- 5997 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @hammad, you can use AgentBricks - Multi Agent Supervisor to achieve the same result. You also use Genie as a Databricks-managed MCP tool. Depending on your situation, you can choose the option that suits you best.
- 0 kudos
- 3687 Views
- 1 replies
- 1 kudos
Exception: The demo llm-rag-chatbot doesn't exist.
Hello,when I try to bring the demo environment (LLM Chatbot With Retrieval Augmented Generation (RAG) and DBRX) into my Databricks workspace, I get the following error: Exception: The demo llm-rag-chatbot doesn't exist.I execute the following code: %...
- 3687 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @xiinex - You are right. This demo is now deprecated. Please use the ai-agent demo.
- 1 kudos
