- 38625 Views
- 22 replies
- 48 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 38625 Views
- 22 replies
- 48 kudos
- 48 kudos
Dear Certifications TeamI have completed full Generative AI Engineering Pathway, so I received module wise knowledge badge but I didn't received the overall certificate which mentioned in description which is Generative AI Engineer with one Star. Req...
- 48 kudos
- 13109 Views
- 1 replies
- 0 kudos
How can I utilize multiple GPUs from multiple nodes in Databricks
I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...
- 13109 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you try the Serverless GPU Compute? https://docs.databricks.com/aws/en/machine-learning/sgc-examples/gpu-batch-inference
- 0 kudos
- 608 Views
- 1 replies
- 1 kudos
Ai query parallel calls
I’m trying to optimize ai_query calls on a table and wanted to get some ideas.So far, I’ve tried repartitioning the DataFrame before running spark.sql(ai_query), but I didn’t see any meaningful performance gains. I also experimented with running mult...
- 608 Views
- 1 replies
- 1 kudos
- 1 kudos
When you are using ai_query(), there are two main aspects to performance: Model serving endpointSQL warehouse / Compute cluster Very likely, the performance is throttled by the model-serving endpoint's concurrency limit. Reference: https://docs.d...
- 1 kudos
- 3210 Views
- 4 replies
- 4 kudos
Resolved! Where are GPT-5 and Gemini in Azure Databricks?
Are GPT-5 and Gemini not available in Azure Databricks? According to Native OpenAI Models Now Generally Available on Databricks | Databricks Blog and Google’s Gemini Models on Databricks | Databricks Blog these are both GA with no mention of platfor...
- 3210 Views
- 4 replies
- 4 kudos
- 4 kudos
An update: our account manager that the GPT models are available to accounts with a committed spend agreement, but not to the paygo customers. We are a paygo customer, we have not reached the threshold of committed spend yet. I think most of the sm...
- 4 kudos
- 1515 Views
- 1 replies
- 2 kudos
Security considerations and model customization options for AgentBricks AI Agents and LLM Judges
Hello Databricks Team,We are currently evaluating AgentBricks AI Agents (for example, Knowledge Assistant and Multi-Agent Supervisor) and would like to better understand the security and model customization aspects.Data security & privacyWhat data (u...
- 1515 Views
- 1 replies
- 2 kudos
- 2 kudos
@shivamrai162 1. Data security & privacy Agent Bricks uses default storage to store temporary data transformations, model checkpoints, and internal metadata that power each agent. On agent deletion, all data associated with the agent is removed from ...
- 2 kudos
- 1927 Views
- 2 replies
- 2 kudos
Resolved! How to use CrewAI with Databricks-hosted LLMs (not OpenAI) ?
I am trying to use CrewAI to train an agent with a Databricks-hosted LLM (such as Llama 2 instruct or DBRX) via the databricks_langchain integration. I want CrewAI to use only my Databricks LLM and not requiring OpenAI authentication.However, when I ...
- 1927 Views
- 2 replies
- 2 kudos
- 2 kudos
@lucami To configure CrewAI to use only Databricks-hosted models without OpenAI dependencies Use CrewAI's LLM class (which wraps litellm) rather than ChatDatabricks Pass the LLM at both levels: agents use it to complete their tasks, and the crew u...
- 2 kudos
- 1129 Views
- 1 replies
- 3 kudos
Resolved! What functions privileges are required to create/see Unity Catalog Function MCPs?
When you go AI/ML -> Agents - MCP Servers you can see the schema names with a server type UC Function for seemingly all schemas that contain Unity Catalog functions that you have created. However, when my colleague creates a function in a different s...
- 1129 Views
- 1 replies
- 3 kudos
- 3 kudos
Now I see. My colleague didn't create a function, but a procedure. It is listed as a function in the MCP Servers view, but it is different in that it is a sequence of statements.
- 3 kudos
- 1793 Views
- 3 replies
- 2 kudos
Resolved! Clouds in Databricks
I'm trying to understand the differences between the clouds that offer Databricks, and I'm interested in GCP. However, I'm unsure if choosing GCP would allow me to use AI functionalities like Agent Bricks. Regardless of the cloud I choose, will I hav...
- 1793 Views
- 3 replies
- 2 kudos
- 2 kudos
In my experience, Azure Databricks leads in rolling out new features, and GCP is generally the last.
- 2 kudos
- 398 Views
- 0 replies
- 0 kudos
Where Data + Gen AI Adds Value in Modern Data Platforms
Data + Gen AI is most effective when grounded in real data constraints.On Databricks, combining Gen AI with Spark and Delta accelerates prototyping and testing, but fundamentals still matter—schema design, realistic distributions, and domain understa...
- 398 Views
- 0 replies
- 0 kudos
- 5620 Views
- 5 replies
- 2 kudos
Resolved! Documentation on all ways to access agent serving endpoint from outside databricks
Struggling to find clear documentation which can help me with the subject. Need to know all the ways (production best practices) along with API method. As far as I know, using PAT is not a production best practice
- 5620 Views
- 5 replies
- 2 kudos
- 2 kudos
To access an Agent serving endpoint without a Personal Access Token (PAT), you must use OAuth 2.0 Machine-to-Machine (M2M) authentication. This is the industry-standard approach for production applications.1. OAuth M2M Authentication WorkflowInstead ...
- 2 kudos
- 843 Views
- 1 replies
- 0 kudos
- 843 Views
- 1 replies
- 0 kudos
- 0 kudos
For every endpoint there will be an inference table that can be configured to store the logs . https://docs.databricks.com/aws/en/ai-gateway/inference-tables#enable-and-disable-inference-tablesYou can then query and analyze this table - https://docs....
- 0 kudos
- 1576 Views
- 2 replies
- 0 kudos
Resolved! Agents button is missing
Dear Community,Recently I've followed the AI Agents on Databricks training and wanted to dive into AI world using my company Databricks account.After logging in to the workspace I was quite surprised to see that the Agents button in AI/ML menu is mis...
- 1576 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @kuznetsovvs , I checked this internally and on Azure, the Mosaic AI Agent Framework and Model Serving are supported in West Europe, the Agent Bricks UI itself is limited to specific regions (primarily in US). That's why the “Agents” button doesn’...
- 0 kudos
- 2030 Views
- 3 replies
- 1 kudos
Resolved! multi agent Genie AI app in serving endpoint fails with PERMISSION ERROR on Databricks tabls.
I have deployed simple multi agent genie app on serving endpoint and it always fails PERMISSION error on tables accessed by Genie agent, however the same app works perfectly when tested from notebook. not sure what am i missing here. I checked all th...
- 2030 Views
- 3 replies
- 1 kudos
- 1 kudos
hi @davidmorton thanks for responding, I am only using databricks_token for my authentication when tested via notebook. Can you help what changes needs to be done as per below notebook to enable access to tables when model deployed in serving endpoin...
- 1 kudos
- 1017 Views
- 1 replies
- 2 kudos
Resolved! How to create an information extraction agent (Trial Version)
I haven't been using Databricks for very long and I'm testing how things work. I tried to create a pre-built agent to extract information from one of my tables, but I get an error when I click create: "Permission denied: provisioned throughput is not...
- 1017 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Artur1 If you are using Agent Bricks to create the agent, this feature is not supported in the Databricks free edition.Please refer here Databricks Free Edition limitations
- 2 kudos
- 3661 Views
- 7 replies
- 1 kudos
Azure Content Understanding Equivalent
Hi all,I am exploring Databricks services or components that could be considered equivalent to Azure Document Intelligence and Azure Content Understanding.Our customer works with dozens of Excel and PDF files. These files follow multiple template typ...
- 3661 Views
- 7 replies
- 1 kudos
- 1 kudos
I would work, but you will need to specify and manage the ranges or number of header rows manually. You could potentially read the whole sheet in and then write some code that identifies the range that is of interest and cleans it in parsing. My reco...
- 1 kudos
- 2844 Views
- 1 replies
- 1 kudos
Databricks Vector Search Algorithm
I’m working on using Databricks vector search combined with full-text search in my application. I want to filter queries by the id field in my vector search index. I noticed that there is a limit of 1,024 IDs per query when using filters.If I need to...
- 2844 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @deane , I worked on a similar issue months earlier and the limit of 1024 is not configurable (no explicit way to increase the filter count), so my suggestion back then was to perform a two step process like filter for half of the filters once and...
- 1 kudos
