- 31398 Views
- 19 replies
- 38 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 31398 Views
- 19 replies
- 38 kudos
- 38 kudos
This is an exciting step forward from Databricks! Looking forward to diving into the curriculum and exploring what's next in the world of data + AI! Thanks for sharing @Sujitha
- 38 kudos
- 793 Views
- 3 replies
- 1 kudos
Error from mlflow traces in Databricks notebook
I'm unable to log my traces in my mlflow experiments.The goal is to have the tracing from my genAI calls like described in Tutorial: Connect your development environment to MLflow .So I'm able to create my experiment run, but they are every time empt...
- 793 Views
- 3 replies
- 1 kudos
- 1 kudos
@rafaelgildin , I see that you have raised an Issue in the OSS mlflow repo, while the issue that you are encountering is on Databricks. The issue here is that you are explicitly adding trace.set_tracer_provider(tracer_provider). Databricks installs i...
- 1 kudos
- 481 Views
- 1 replies
- 1 kudos
model-specific tools (code interpreters, search, etc.) for OpenAI / Anthropic / Google
Hi,I’m happy to see that the latest models from the three major AI labs (OpenAI, Anthropic, and Google) are now available on Databricks. I had a follow-up question about what exactly is supported.Is Databricks only exposing the base models, or are so...
- 481 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Rahul-vlk You can use the models both as Databricks-hosted “first‑party” endpoints and via “external model” endpoints that proxy to the provider’s hosted APIs, all through a unified, OpenAI‑compatible interface for chat, embeddings, vision, and ...
- 1 kudos
- 326 Views
- 1 replies
- 1 kudos
Resolved! Lakesense Auth Error When Creating Multiple Knowledge Assistant Agents in Databricks
I’m encountering an issue related to Lakesense authentication when working with Agent Bricks Knowledge Assistant (KA) agents (I recreated thisAgent Bricks Knowledge Assistant agent), and I haven’t found any documentation on this. Hoping someone here ...
- 326 Views
- 1 replies
- 1 kudos
- 1 kudos
Update: The new agents I create are now working as expected. A Databricks architect suggested that the earlier issue might have been due to a backend outage, since customers typically shouldn’t encounter Lakesense errors. At this point, any newly cre...
- 1 kudos
- 410 Views
- 1 replies
- 0 kudos
How do I build a retrieval-augmented generation (RAG) pipeline on Databricks — what are the best pra
How can I build an AI system (using Databricks) where the AI model doesn’t just rely on its built-in knowledge, but also retrieves real information from a database or documents before answering?
- 410 Views
- 1 replies
- 0 kudos
- 0 kudos
@Suheb , We have a bunch of resources around Databricks RAG. Did you have a chance to look at the available documentation? Adding a few of them below. Databricks docs for RAG: https://docs.databricks.com/aws/en/generative-ai/retrieval-augmented-gener...
- 0 kudos
- 270 Views
- 2 replies
- 1 kudos
Random/Rare Bad Request error with Agent Serving endpoint
Whats the reason behind receiving below error at some rare occassions (once in a month)?"error_code": "BAD_REQUEST", "message": "Encountered an unexpected error while evaluating the model. Verify that the input is compatible with the model for infere...
- 270 Views
- 2 replies
- 1 kudos
- 1 kudos
@Rajat-TVSM That message is the generic model-serving “bad request” wrapper we return when a predict operation fails or the request doesn’t match the model’s expected input. The quickest way forward is to validate your payload against the model sign...
- 1 kudos
- 332 Views
- 3 replies
- 2 kudos
Tags are not getting propagated immediately to Genie space for filtering Data Assets
Hi Databricks Team,I have created a Table and added a tag to it but i couldn't see that tag immediately in the Genie Space for filtering. It seems to be an issue of eventual consistency. I added a tag to a table and it seems to take 2 days to reflect...
- 332 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @Louis_Frolio ,Thanks for your inputs.Is there a way to add tables / views via SDK / API to Genie spaces?
- 2 kudos
- 297 Views
- 1 replies
- 1 kudos
agent bricks - can't figure out how to enable Knowledge Assistant
Hi, getting this error when trying to build a Knowledge Assistant agent: I have a premium account in the eastus region. The docs say I need to have a 'serverless budget policy' configured, but despite all my attempts, i can't get it to show up as an ...
- 297 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi Steph, it sounds like the Knowledge Assistant requires a serverless budget policy linked to your premium account. If it’s not showing in admin settings, it’s often a region/configuration issue. I’d recommend:Double-check that your East US account ...
- 1 kudos
- 396 Views
- 2 replies
- 1 kudos
Resolved! Help with hybrid search function
I need help writing a filter. I want to pre-filter a vector index before performing a hybrid search and create this as a function. Below is a simple example of searching for products for a given customer. A prefilter is key as this provides author...
- 396 Views
- 2 replies
- 1 kudos
- 1 kudos
@the_peterlandis, Yes, currently vector_search SQL function doesn't provide pre filter support. However, if you must implement the UC function for this, you can do it something like below using Python code with filters. %sql CREATE OR REPLACE FUNCT...
- 1 kudos
- 332 Views
- 1 replies
- 3 kudos
Multi-agent chatbot Optimization
We have developed a multi-agent chatbot using LangGraph within the Databricks environment. The solution is functional, but we are facing challenges related to performance observability and end-to-end optimization.We need guidance in the following are...
- 332 Views
- 1 replies
- 3 kudos
- 3 kudos
Hi @Saurabh2406 , This sounds like a fairly advanced use case - are you in touch with your account team at Databricks? They would be able to provide you with more detailed guidance on this use case. They could also get you connected with internal spe...
- 3 kudos
- 1141 Views
- 6 replies
- 0 kudos
How to Use Databricks Repos for Collaborative Development and CI/CD Integration?
I’d like to gather insights, best practices, and real-world experiences from anyone who has worked with Databricks Repos for team-based development. Databricks Repos is designed to streamline source control, versioning, and automation, but the workfl...
- 1141 Views
- 6 replies
- 0 kudos
- 0 kudos
Databricks Repos make collaborative development easy by connecting notebooks to Git. You can work on branches, track changes, and sync with your team. Plus, they integrate with CI/CD pipelines, allowing automated testing and deployment of notebooks o...
- 0 kudos
- 1186 Views
- 3 replies
- 5 kudos
Resolved! Information Extraction Agent - Update Agent failed
Hi everyone,I’m running into a persistent issue when trying to save an Information Extraction Agent in Databricks.Every time I click Save and update, I get: Update Agent failed. Failed to save AgentThis happens regardless of what I change — schema, g...
- 1186 Views
- 3 replies
- 5 kudos
- 5 kudos
It sounds like the update for your Information Extraction Agent didn’t go through successfully. A few things you could try:Check logs – Look for any error messages during the update process; they often give clues about what went wrong.Verify dependen...
- 5 kudos
- 411 Views
- 2 replies
- 0 kudos
Resolved! Agent Bricks Multi Agent Supervisor failing update
Hello,I recently created a Multi Agent supervisor yesterday and it is working fine till date but when i created a second Multi Agent Supervisor assistant, im facing below error: Endpoint update failedFailed to deploy : Quota Exceeded: You've hit the ...
- 411 Views
- 2 replies
- 0 kudos
- 0 kudos
Thanks Advika, I have deleted some of the endpoints and its working now. Also wanted to know if instead of deleting the endpoint, can I just pause it or scale it to zero to avoid endpoint cost.
- 0 kudos
- 795 Views
- 3 replies
- 0 kudos
Resolved! Measuring latency metrics like TTFT, TBT when deploying agents on Databricks
Is there an inbuilt method to measure latency metrics like TTFT, TBT when deploying agents on Databricks? Using MLFlow ChatAgent, ChatDatabricks/OpenAI client(workspace client)What would be the way to measure them in case no inbuilt method exists?
- 795 Views
- 3 replies
- 0 kudos
- 0 kudos
@Rajat-TVSM , You’re close: for production observability you can use server‑side tracing when you deploy agents on Databricks, and client‑side instrumentation when the app runs outside; you don’t have to rely only on the client side. What to use in ...
- 0 kudos
- 5455 Views
- 3 replies
- 1 kudos
Vector search index creation is incredibly slow
I am trying to create a vector search index for a Delta Table using Azure OpenAI embeddings (text-embedding-3-large). The table contains 5000 chunks with approx. 1000 tokens each. The OpenAI embeddings are generated through a Databricks model serving...
- 5455 Views
- 3 replies
- 1 kudos
- 1 kudos
@epistoteles I am also facing the same issue while delta table sync with Index. Could you please share if you have any work around or used some different appoarch to decrease latency.Thanks in advance.
- 1 kudos
- 632 Views
- 4 replies
- 1 kudos
Resolved! Agentic AI Workload Analyzer
Hello Databricks experts,In Automating Best Practices with Agentic AI Workload Analyzer, Krishna Satyavarapu and Nikhil Mishra mentioned "The Agentic AI Workload Analyzer". Is it known when this will be available.cheersMario
- 632 Views
- 4 replies
- 1 kudos
- 1 kudos
Generative AI is transforming how we handle data and automation. The key challenge now is balancing model creativity with control — ensuring reliable outputs while keeping innovation at the core.
- 1 kudos
