- 40459 Views
- 23 replies
- 51 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 40459 Views
- 23 replies
- 51 kudos
- 2400 Views
- 2 replies
- 0 kudos
Databricks REST api to manage and deploy Genie spaces programmatically
Hello,I am looking to find documentation for databricks REST api for creating and deploying genie spaces with necessary configuration. Could you please guide me to the documentation for the same.Regards,Sristi Raj
- 2400 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi all. Justo to follow up this conversation. In these days I developed a simple notebook to deploy my genie space. This notebook is into a Job deployed with asset bundle. After the deployment into the target (dev/prod) the CI/CD run this pipeline to...
- 0 kudos
- 916 Views
- 1 replies
- 1 kudos
Databricks App cannot authenticate to another Databricks App MCP server (OAuth consent redirect)
Hi Team,I am building an MCP client as a Databricks App that connects to an MCP server hosted on another Databricks App. The client works locally but fails when deployed due to OAuth consent redirect.Question: What is the recommended authentication a...
- 916 Views
- 1 replies
- 1 kudos
- 1 kudos
TLDR: For Databricks App-to-App communication, you should use the client app's automatically provisioned Service Principal rather than On-Behalf-Of (OBO) user authentication to avoid interactive OAuth consent redirects.Why Your Local Approach Fails i...
- 1 kudos
- 1429 Views
- 2 replies
- 0 kudos
Resolved! ai_parse_document time out setting
We are using ai_parse_document on ~4k pdf files. We noticed the load is taking quite a bit of time and when we looked into our intermediate table, we are seeing several errors like this:[ { "error_message":"pdf rendering timed out after 1800 s...
- 1429 Views
- 2 replies
- 0 kudos
- 0 kudos
Greetings @TX-Aggie-00 , Thanks for the detailed description and for including the exact error message — that helps. The “pdf rendering timed out after 1800 seconds” message reflects an internal hard timeout during the document rendering step. The 1...
- 0 kudos
- 846 Views
- 2 replies
- 0 kudos
Endpoint not found
Azure Databricks workspace in East US 2.Genie works in UI but Conversation API returns ENDPOINT_NOT_FOUND.How can I enable Genie Conversation API?
- 846 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @alessandrochamp, Can you double-check that the Genie API preview is enabled in your workspace? It is a Public Preview feature, and your error suggests that the preview might not be enabled.
- 0 kudos
- 1643 Views
- 1 replies
- 1 kudos
Resolved! Genie spaces - instructions
Hi all,I'm experimenting with Databricks Genie, I have a setup where Genie is based on a Metrics View. In the Metrics View, we have multiple sales related measures and different kinds of revenue measures. Is anyone aware, if there is an option to add...
- 1643 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello! Yes, this is possible! You can add this to the Instructions Section of your Genie Space. Here's an example: When users ask about "revenue" without specifying which type, always ask for clarification about which revenue measure they want: Total...
- 1 kudos
- 1348 Views
- 1 replies
- 0 kudos
Resolved! How do I get started with Databricks as a complete beginner?
How can a beginner start learning and using Databricks step by step?
- 1348 Views
- 1 replies
- 0 kudos
- 0 kudos
You can use Databricks free edition to test Databricks and practice, even though the path will also depend in your goals as a professional. You can choose one or multiple of the following paths as guidance: Platform, Data Engineering, Traditional ML...
- 0 kudos
- 2082 Views
- 3 replies
- 1 kudos
Resolved! AI Model to Generate Python Utilities
Hi team,I'm working on Databricks and need to choose a model from Foundation Model APIs / AI Playground to generate Python utilities for my infra team. For notebook Assistant (Ctrl+I in cells), which model would you recommend for reliable Python code...
- 2082 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi, They are effectively the same assistant under the hood, it's more the context of where it's working from that's important. So the cell based one will assume you're asking about the specific cell you're in and because it's only a small prompt win...
- 1 kudos
- 1248 Views
- 2 replies
- 2 kudos
Resolved! Harman Singh Deep Kandhari - Gym Owner Aspiring to Learn AI and Generative AI
Hi Everyone,My name is Harman Singh Deep Kandhari, a gym owner eager to learn Artificial Intelligence and Generative AI to enhance fitness services, automate operations, and create smarter, technology-driven workout experiences. Any suggestion from y...
- 1248 Views
- 2 replies
- 2 kudos
- 2 kudos
Thanks Anshu_Roy for your valuable reply. It would be helpful for me. Thanks!!Harmandeep Singh Kandhari
- 2 kudos
- 2880 Views
- 3 replies
- 2 kudos
Resolved! Multi Agent Supervisor w/ Databricks App
Hello, how can I create a databricks app using multi agent supervisor (knowledge assistant + genie) with an interface?
- 2880 Views
- 3 replies
- 2 kudos
- 2 kudos
@mmoise Multi Agent Supervisor (MAS) is an orchestrator agent, so it depends on: 1) how many agents it orchestrates, 2) how complex those agents are, and 3) how complex the user prompt is. I would encourage you to review the MLflow experiment traces...
- 2 kudos
- 1773 Views
- 2 replies
- 4 kudos
Resolved! can I use AI/BI agents inside a databricks app?
is it possible to use the AI/BI agents that I built inside databricks to be called in a databrick app? so far, my finding shows the agent is an UI inside databricks and is not exposed as a rest API but i was wondering if anyone knows a solution to th...
- 1773 Views
- 2 replies
- 4 kudos
- 4 kudos
By AI/BI agents do you mean Genie rooms? If so you can save these as a seperate Genie Room and then the Genie room will have an API endpoint that you can query from within the App. This is currently in public preview at the moment. The docs are here ...
- 4 kudos
- 13180 Views
- 1 replies
- 0 kudos
How can I utilize multiple GPUs from multiple nodes in Databricks
I am currently experimenting with the whisper model for batchwise inference on Databricks and have successfully utilized multiple instances of the model by accessing multiple GPUs available in the driver node. However, I am wondering how I can levera...
- 13180 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you try the Serverless GPU Compute? https://docs.databricks.com/aws/en/machine-learning/sgc-examples/gpu-batch-inference
- 0 kudos
- 731 Views
- 1 replies
- 1 kudos
Ai query parallel calls
I’m trying to optimize ai_query calls on a table and wanted to get some ideas.So far, I’ve tried repartitioning the DataFrame before running spark.sql(ai_query), but I didn’t see any meaningful performance gains. I also experimented with running mult...
- 731 Views
- 1 replies
- 1 kudos
- 1 kudos
When you are using ai_query(), there are two main aspects to performance: Model serving endpointSQL warehouse / Compute cluster Very likely, the performance is throttled by the model-serving endpoint's concurrency limit. Reference: https://docs.d...
- 1 kudos
- 3490 Views
- 4 replies
- 4 kudos
Resolved! Where are GPT-5 and Gemini in Azure Databricks?
Are GPT-5 and Gemini not available in Azure Databricks? According to Native OpenAI Models Now Generally Available on Databricks | Databricks Blog and Google’s Gemini Models on Databricks | Databricks Blog these are both GA with no mention of platfor...
- 3490 Views
- 4 replies
- 4 kudos
- 4 kudos
An update: our account manager that the GPT models are available to accounts with a committed spend agreement, but not to the paygo customers. We are a paygo customer, we have not reached the threshold of committed spend yet. I think most of the sm...
- 4 kudos
- 1640 Views
- 1 replies
- 2 kudos
Security considerations and model customization options for AgentBricks AI Agents and LLM Judges
Hello Databricks Team,We are currently evaluating AgentBricks AI Agents (for example, Knowledge Assistant and Multi-Agent Supervisor) and would like to better understand the security and model customization aspects.Data security & privacyWhat data (u...
- 1640 Views
- 1 replies
- 2 kudos
- 2 kudos
@shivamrai162 1. Data security & privacy Agent Bricks uses default storage to store temporary data transformations, model checkpoints, and internal metadata that power each agent. On agent deletion, all data associated with the agent is removed from ...
- 2 kudos
- 2400 Views
- 2 replies
- 2 kudos
Resolved! How to use CrewAI with Databricks-hosted LLMs (not OpenAI) ?
I am trying to use CrewAI to train an agent with a Databricks-hosted LLM (such as Llama 2 instruct or DBRX) via the databricks_langchain integration. I want CrewAI to use only my Databricks LLM and not requiring OpenAI authentication.However, when I ...
- 2400 Views
- 2 replies
- 2 kudos
- 2 kudos
@lucami To configure CrewAI to use only Databricks-hosted models without OpenAI dependencies Use CrewAI's LLM class (which wraps litellm) rather than ChatDatabricks Pass the LLM at both levels: agents use it to complete their tasks, and the crew u...
- 2 kudos
