Hey Databricks Community! Join us for a free community-sponsored BrickTalk on Thursday, September 24, 2026. BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Da...
- 418 Views
- 2 replies
- 2 kudos
2 weeks ago
FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 172 Views
- 0 replies
- 0 kudos
yesterday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1189 Views
- 0 replies
- 3 kudos
3 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 151435 Views
- 242 replies
- 70 kudos
08-21-2026
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 1035 Views
- 0 replies
- 2 kudos
3 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 3503 Views
- 0 replies
- 3 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 795 Views
- 6 replies
- 7 kudos
a week ago
Public sector agencies need well-informed decisions to support the livelihood and security of citizens. The Entity Resolution for Public Sector Solution Accelerator shows how entity resolution can connect disparate data sources, reveal relationships ...
- 123 Views
- 0 replies
- 0 kudos
yesterday
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 318 Views
- 0 replies
- 4 kudos
a week ago
Community Activity
- 57 Views
- 2 replies
- 1 kudos
Serverless DNS failures after trial upgrade (AWS us-east-2)
Our AWS Premium serverless workspace in us-east-2 cannot resolve several public domains. We added a payment method, and the account UI confirms that the trial upgrade is complete.Three fresh serverless notebook runs on September 24, 2026, at approxim...
- 57 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
@revian thanks for the detailed diagnostics. If the account used express setup, Databricks notes that some trial restrictions can persist after upgrading. A remaining network restriction is worth checking, but isn't confirmed here.If available, check...
- 1 kudos
- 19 Views
- 0 replies
- 0 kudos
USE CONNECTION bypasses your MCP Service's Tool Selection and Policies
I registered a mock MCP server in Unity Catalog, exposed only its read tool, attached a deny policy, and then called the delete tool anyway. What decided the outcome was access to the underlying connection, and it came from grants on the schema, not ...
- 19 Views
- 0 replies
- 0 kudos
- 434 Views
- 5 replies
- 1 kudos
Resolved! Lakebase Data API – First Request Times Out After 8 Seconds When Compute Is Offline
Hi Everyone,I’m using the Databricks Lakebase Data API and have noticed that the first API call consistently times out after approximately 8 seconds when the Lakebase compute is offline.The first request triggers the compute to start, and the compute...
- 434 Views
- 5 replies
- 1 kudos
Latest Reply
- 1 kudos
Update on this post: I have raised a support case with Databricks and requested that the timeout be increased. The timeout has been increased to 20 seconds.
- 1 kudos
- 102 Views
- 4 replies
- 3 kudos
Databricks Data Quality - Agent Proposes, DQX Disposes
Every serious data platform grows a dead-letter table, and it always becomes a graveyard. Here is how we turned one into a self-healing queue — without letting a language model anywhere near the warehouse.Every data platform that takes quality seriou...
- 102 Views
- 4 replies
- 3 kudos
Latest Reply
- 3 kudos
Thanks for sharing, @KeerthiItigimat, what a great breakdown. How do you handle rules changing while rows are waiting in quarantine? Does remediation keep the original checks, use the latest approved rules, or run both?
- 3 kudos
- 9860 Views
- 19 replies
- 17 kudos
FAQ for Advanced Learning Festival September 16 - October 14 2026
Frequently Asked Questions Databricks Advanced Learning Festival | September 16 - October 14 2026 General Where can I ask questions while going through the self-paced material? The Databricks Academy Learners Group page is a forum within the Data...
- 9860 Views
- 19 replies
- 17 kudos
Latest Reply
- 17 kudos
I am completing Analyst modules right now. The voucher that I will get will be for that modules certification only or I can use it for Data Engineering Certification also in case I want to change my path in future?
- 17 kudos
- 28 Views
- 0 replies
- 0 kudos
My Databricks Certification exam suspended randomly
Hi Databricks Team @Cert-Team @Cert-TeamOPS @Cert-Bricks ,I’m posting here because I would really appreciate an official response or guidance regarding my certification exam suspension.My Databricks certification exam was suspended before I was able ...
- 28 Views
- 0 replies
- 0 kudos
- 47 Views
- 1 replies
- 2 kudos
Operationalizing Lakeflow Connect:Handling Upstream Schema Evolution & Historical Backfill
Hi everyone,I’m currently evaluating Lakeflow Connect for our ingestion layer. While the setup for replicating source databases into the Lakehouse is remarkably streamlined, I’m looking for operational best practices from those of you using it in pro...
- 47 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
@Khasim_1 which source are you using? The details vary by connector. For SQL Server, new columns are ingested automatically by default, but renames and type changes require a full refresh of the affected table. Selecting a previously excluded column ...
- 2 kudos
- 85 Views
- 3 replies
- 1 kudos
Resolved! Genie Agents citation (bug)
Agent reponses are showing this kind of plain text at the end of its text reponses: :citation[genie_sql.01f1b7e5-18d5-196a-90f2-2601ef936192]I think it is meant to be a clickable link. Will this be fixed soon?
- 85 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @haaland - I believe the fix has now been rolled out, and I have tested my sandbox workspace where citations are working correctly. Please check and let me know if you still face issues. Happy to follow up internally.
- 1 kudos
- 59 Views
- 1 replies
- 1 kudos
Spark Internals on Databricks
Every Spark engineer eventually hits the same wall: the query works, but you don't know why it's slow, or why it suddenly got fast after a one-line config change. The gap between "I can write Spark SQL" and "I can reason about Spark's execution" is a...
- 59 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Thanks for sharing this, @aayush_410 - really useful breakdown and important topic.One small nuance that might be worth mentioning around "EXPLAIN FORMATTED": with AQE, SQL "EXPLAIN" doesn't execute the query, so it only shows the initial plan rather...
- 1 kudos
- 45 Views
- 1 replies
- 1 kudos
New Databricks SQL window fuction: counter_diff
This function was designed to work with cumulative counters in time series. It automatically calculates the difference between the current and previous value, turning a cumulative counter into a per-period variation.Let's look at a practical example....
- 45 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
The counter_diff function is a significant upgrade over the traditional LAG() approach for IoT and telemetry data because it is "reset-aware."While a standard subtraction (Current - LAG(Previous)) produces a large negative number when a hardware coun...
- 1 kudos
- 158 Views
- 7 replies
- 6 kudos
Resolved! Is Advanced edition required for Serverless pipeline?
I want to set Serverless pipeline with edition=PRO, but it raises the following error: cannot update pipeline: You must use the Advanced edition when using serverless compute.This is not specified anywhere in the documentation. It only says (see scr...
- 158 Views
- 7 replies
- 6 kudos
Latest Reply
- 6 kudos
Serverless DLT/Lakeflow pipelines currently mandate the "Advanced" edition.Even if you are not using Data Quality expectations (the most famous "Advanced" feature), the Serverless orchestration itself relies on advanced infrastructure management, enh...
- 6 kudos
- 136 Views
- 2 replies
- 0 kudos
I entered my credit card details 4 daysa go but i cant get access to openAI or Opus models
Even via the play ground i get this error:InternalError{"error_code":"PERMISSION_DENIED","message":"PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0."}It looks like most of the models are not activated f...
- 136 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hey @mikelben ! According to an official resolution provided by a Databricks Employee on the community forums, this specific "Permission_Deneid" error occurs when you are in the free/trial phase. The "rate limit of 0" is a backend restriction that ty...
- 0 kudos
- 112 Views
- 5 replies
- 0 kudos
Resolved! How to override ABAC policies
I'm struggling with the best way to handle ABAC inheritance. Here's the situation:We have tags deployed in table columns across a dozen catalogs and their schemas. In general, certain tags should have column masking policies applied so that our user ...
- 112 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
Awesome. Thank you both again, this is fairly simple to implement with our terraform code. You both gave great answers so I don't know who to accept as solution! I'll just pick the last response.Thanks again!
- 0 kudos
- 36 Views
- 0 replies
- 0 kudos
From Databricks POCs to Building a Data + AI Community
Over the last few years, I have spent a lot of time experimenting with one question: How do we turn Data + AI capabilities into applications people actually want to use?That curiosity led me to build multiple POCs and applications using Databricks + ...
- 36 Views
- 0 replies
- 0 kudos
- 76 Views
- 2 replies
- 1 kudos
Access to Lakehouse Real-Time (RT) in the preview tab
Hi Databricks team,we are currently doing an performance-centric assessment of Databricks and it would be great if we could also try the beta feature Lakehouse RT but this is not yet listed under the preview features. Is there any chance to get acces...
- 76 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @daniel_benchANT, Lakehouse//RT is currently in Beta, and it's gated, which is why you are not seeing it listed on the Previews page in your workspace yet. The feature only appears there after your Databricks account team has enabled it for your s...
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1443 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Multi-region model serving on Databricks with OpenSharing
Introduction Enterprises today serve customers across continents, from New York to Singapore, London to São Paulo. For these organizations, delivering fast, reliable user experiences is a business req...
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read. One way to improve the...
