The Genie has spoken And the winners of the Genie-Powered App Challenge are… A few weeks ago, we threw down a challenge: build something incredible with Databricks Apps and Genie Agent. And wow, you delivered. From smart, real-world prob...
- 826 Views
- 9 replies
- 7 kudos
Thursday
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, September 17, 2026! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with d...
- 347 Views
- 0 replies
- 2 kudos
Monday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 679 Views
- 0 replies
- 2 kudos
2 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 50050 Views
- 67 replies
- 39 kudos
3 weeks ago
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 541 Views
- 0 replies
- 2 kudos
2 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 2682 Views
- 0 replies
- 3 kudos
08-11-2026
Product onboarding can be complex and time-consuming when teams work with inconsistent data formats, inaccurate information and multiple stakeholders. The Simplifying Product Onboarding With Generative AI Solution Accelerator shows how generative AI ...
- 121 Views
- 0 replies
- 0 kudos
Tuesday
The Weekly Digest • August 31 – September 6 Community Pulse Your weekly pulse: new articles, real answers, and the discussions worth watching. This Week's Community Stars This week's difference-makers – and a shout-out to the new members ear...
- 304 Views
- 0 replies
- 1 kudos
Tuesday
Community Activity
- 703 Views
- 3 replies
- 2 kudos
Azure Databricks Genie + Copilot Studio: MCP tools discovered and enabled, but Copilot never invokes
Hi everyone,I'm trying to integrate an Azure Databricks Genie Agent with Microsoft Copilot Studio through the MCP integration, and I'm stuck in a situation where everything appears correctly configured, but Copilot never actually invokes the Genie to...
- 703 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
@tdcouto That split (new UI broken, legacy UI fine) actually lines up with the harness distinction from my note above. The two Copilot Studio UIs aren't just a skin difference, the new UI runs agents on a different underlying orchestration runtime (t...
- 2 kudos
- 71 Views
- 1 replies
- 0 kudos
How do you test whether a retriever stops too early?
Hello everyone,Databricks’ Adaptive Instructed-Retriever announcement describes a model that learns when to stop searching. How would you test whether it stops after finding a general policy but before finding the exception that changes the answer?I...
- 71 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
This is a good framing question. A few things that have worked well for evaluating early-stopping retrieval specifically: Build a small labeled set where each query has a known minimal sufficient evidence set (the specific chunks/passages a correct a...
- 0 kudos
- 113 Views
- 2 replies
- 0 kudos
Enterprise workspace blocked by Databricks-set rate limit of 0 on all models (AWS Marketplace)
I'm on an Enterprise plan (billed via AWS Marketplace, active payment method, $399 credit remaining) and every model in my Unity AI Gateway — glm-5-3-flash, claude-opus-5, grok-4-6, gpt-5-6-sol, etc. — returns:"error_code":"PERMISSION_DENIED","messag...
- 113 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
@khanzada This is the same trust-tier gate as the earlier thread here: https://community.databricks.com/t5/generative-ai/premium-pay-as-you-go-account-still-blocked-by-databricks-set/td-p/166879 - it's not a per-model rate limit, a budget, or your pl...
- 0 kudos
- 120 Views
- 2 replies
- 1 kudos
Unable to Start Serverless Compute in Databricks Free Edition
Hello everyone,I am using Databricks Free Edition. I had not used my account for quite some time, and I recently logged in to start working again.When I try to start Serverless Compute, I get the following error:Cannot start serverless computeHas any...
- 120 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @HariSankar, Welcome back to Databricks! Here are some options to help you work through this. Firstly, check whether you are on the Free Edition or the old Databricks Free Edition. This is the most common cause of this exact error. The legacy Co...
- 1 kudos
- 57 Views
- 0 replies
- 0 kudos
Best practices for SLA monitoring and automated retries across hundreds of Lakeflow Jobs
Hi everyone,We are in the process of migrating our legacy Airflow DAGs (largely time-based cron schedules) to Lakeflow Jobs, and I want to fully leverage the platform's event-driven capabilities rather than just replicating the old "timer-based" patt...
- 57 Views
- 0 replies
- 0 kudos
- 66 Views
- 0 replies
- 0 kudos
igrating from Cron-based Airflow to Lakeflow's Data-Aware Triggers — Real-world experiences?
Hi everyone,We are in the process of migrating our legacy Airflow DAGs (largely time-based cron schedules) to Lakeflow Jobs, and I want to fully leverage the platform's event-driven capabilities rather than just replicating the old "timer-based" patt...
- 66 Views
- 0 replies
- 0 kudos
- 4429 Views
- 11 replies
- 11 kudos
FAQ for Advanced Learning Festival September 16 - October 14 2026
Frequently Asked Questions Databricks Advanced Learning Festival | September 16 - October 14 2026 General Where can I ask questions while going through the self-paced material? The Databricks Academy Learners Group page is a forum within the Data...
- 4429 Views
- 11 replies
- 11 kudos
- 66 Views
- 0 replies
- 0 kudos
Task Success is not Routing Health: a Databricks Smart Routing Case Study
I ran the same 24 coding tasks through three arms: fixed Haiku, fixed Opus and Databricks-managed selection. The managed-selection arm passed all 24 tasks. Its 24 routing records also said task profiling was unavailable.That is not a contradiction. T...
- 66 Views
- 0 replies
- 0 kudos
- 255 Views
- 3 replies
- 3 kudos
How Can I Become a Databricks Partner Champion Through Technical Expertise?
Hello Databricks Community,I am actively building my technical expertise in the Databricks ecosystem and would like guidance on the roadmap to becoming a Databricks Partner Champion, with a strong focus on technical skills and hands-on implementation...
- 255 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
Edit: More information in one place What are the current eligibility requirements for the Databricks Partner Champion Program?You need to meet the prerequisites, including 2 Fundamental certifications (Data + Generative AI Fundamentals), 1 Associate-...
- 3 kudos
- 52 Views
- 0 replies
- 1 kudos
DevOps Essentials for Data Engineering: Lab does not match Videos
Hi,The Lab for DevOps Essentials for Data Engineering does not match the training videos.The videos and demos talk about health data while the lab uses taxi data.No additional details is required for this to be understand as something that would bene...
- 52 Views
- 0 replies
- 1 kudos
- 193 Views
- 2 replies
- 3 kudos
Resolved! Best Practice for Handling Schema Evolution with Auto Loader in Production?
Hi Databricks Community,I’d like to hear how other Data Engineers are handling schema evolution with Auto Loader in production environments.Consider the following scenario:We have a continuously running ingestion pipeline using Auto Loader that proce...
- 193 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
You can absolutely leverage Databricks Genie and the new Genie Ontology to handle downstream changes caused by addNewColumnsWithTypeWidening, and handle the changes using Genie ontology, but it requires understanding the division of labor between you...
- 3 kudos
- 455 Views
- 2 replies
- 2 kudos
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of martech sources, including ad connectors like Google ...
- 455 Views
- 2 replies
- 2 kudos
- 69 Views
- 0 replies
- 0 kudos
Why External Secrets in Unity Catalog Matter
Modern data and AI workloads rarely operate in isolation. Pipelines connect to operational databases. Notebooks call third-party APIs. Agents invoke external tools. Applications use tokens, passwords, certificates, and API keys to reach the systems a...
- 69 Views
- 0 replies
- 0 kudos
- 164 Views
- 1 replies
- 2 kudos
Announcing Databricks AppQuest: Hands-On Guidance and Cash Prizes for APJ Developers
SINGAPORE, [DATE] 2026, Databricks and AngelHack today announced Databricks AppQuest, a five-quest learning program that helps developers across Asia Pacific and Japan (APAC) build and ship working AI applications faster - taking them from an idea to...
- 164 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Since 2011, AngelHack has been a global leader in developer relations and marketing, helping tech companies connect with a worldwide developer community.
- 2 kudos
- 109 Views
- 1 replies
- 1 kudos
Changing Root Metastore Location
We currently have a default root metastore location linked to an ADLS container.At the same time we are working on a ADLS migration project.All of the tables and files (everything we use for day to day business related) have moved to the new ADLS so ...
- 109 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
@yawningbrain this is a great topic. The Azure Databricks documentation supports removing the existing metastore root and adding a new path. You cannot edit the existing path in place. This does not migrate existing data. When you remove the root, c...
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1408 | |
| 1253 | |
| 1186 | |
| 961 |
Latest from our Blog
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of mar...
Meet SDP Rewind: An undo button for your ETL pipelines
It's Saturday morning, and your phone goes off. A deployment that shipped Friday afternoon has been quietly writing bad data into your pipeline ever since, and now downstream dashboards are wrong. So ...
Actually understanding Unity Catalog Managed Tables
The “why” worth knowing Choosing external tables is usually about flexibility: you keep dedicated storage, maintain raw files that multiple engines can query directly, and control your own partitionin...
Introducing Stream-Stream Join Support in Apache Spark Real-Time Mode
Summary Explore how Real-Time Mode for Apache Spark Structured Streaming on Databricks now supports inner stream-stream joins in update mode — with sub-second latency.See it in action on a real-time a...
