Hey Databricks Community! Join us for a free community-sponsored BrickTalk on Thursday, September 24, 2026. BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Da...
- 410 Views
- 2 replies
- 2 kudos
a week ago
FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 170 Views
- 0 replies
- 0 kudos
yesterday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1188 Views
- 0 replies
- 3 kudos
3 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 150816 Views
- 241 replies
- 70 kudos
08-21-2026
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 1029 Views
- 0 replies
- 2 kudos
3 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 3499 Views
- 0 replies
- 3 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 790 Views
- 6 replies
- 7 kudos
a week ago
Public sector agencies need well-informed decisions to support the livelihood and security of citizens. The Entity Resolution for Public Sector Solution Accelerator shows how entity resolution can connect disparate data sources, reveal relationships ...
- 120 Views
- 0 replies
- 0 kudos
yesterday
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 317 Views
- 0 replies
- 4 kudos
a week ago
Community Activity
- 9821 Views
- 19 replies
- 17 kudos
FAQ for Advanced Learning Festival September 16 - October 14 2026
Frequently Asked Questions Databricks Advanced Learning Festival | September 16 - October 14 2026 General Where can I ask questions while going through the self-paced material? The Databricks Academy Learners Group page is a forum within the Data...
- 9821 Views
- 19 replies
- 17 kudos
Latest Reply
- 17 kudos
I am completing Analyst modules right now. The voucher that I will get will be for that modules certification only or I can use it for Data Engineering Certification also in case I want to change my path in future?
- 17 kudos
- 17 Views
- 0 replies
- 0 kudos
My Databricks Certification exam suspended randomly
Hi Databricks Team @Cert-Team @Cert-TeamOPS @Cert-Bricks ,I’m posting here because I would really appreciate an official response or guidance regarding my certification exam suspension.My Databricks certification exam was suspended before I was able ...
- 17 Views
- 0 replies
- 0 kudos
- 87 Views
- 2 replies
- 1 kudos
Databricks Data Quality - Agent Proposes, DQX Disposes
Every serious data platform grows a dead-letter table, and it always becomes a graveyard. Here is how we turned one into a self-healing queue — without letting a language model anywhere near the warehouse.Every data platform that takes quality seriou...
- 87 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Thanks for sharing, @KeerthiItigimat, what a great breakdown. How do you handle rules changing while rows are waiting in quarantine? Does remediation keep the original checks, use the latest approved rules, or run both?
- 1 kudos
- 38 Views
- 1 replies
- 2 kudos
Operationalizing Lakeflow Connect:Handling Upstream Schema Evolution & Historical Backfill
Hi everyone,I’m currently evaluating Lakeflow Connect for our ingestion layer. While the setup for replicating source databases into the Lakehouse is remarkably streamlined, I’m looking for operational best practices from those of you using it in pro...
- 38 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
@Khasim_1 which source are you using? The details vary by connector. For SQL Server, new columns are ingested automatically by default, but renames and type changes require a full refresh of the affected table. Selecting a previously excluded column ...
- 2 kudos
- 73 Views
- 3 replies
- 1 kudos
Resolved! Genie Agents citation (bug)
Agent reponses are showing this kind of plain text at the end of its text reponses: :citation[genie_sql.01f1b7e5-18d5-196a-90f2-2601ef936192]I think it is meant to be a clickable link. Will this be fixed soon?
- 73 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @haaland - I believe the fix has now been rolled out, and I have tested my sandbox workspace where citations are working correctly. Please check and let me know if you still face issues. Happy to follow up internally.
- 1 kudos
- 55 Views
- 1 replies
- 1 kudos
Spark Internals on Databricks
Every Spark engineer eventually hits the same wall: the query works, but you don't know why it's slow, or why it suddenly got fast after a one-line config change. The gap between "I can write Spark SQL" and "I can reason about Spark's execution" is a...
- 55 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Thanks for sharing this, @aayush_410 - really useful breakdown and important topic.One small nuance that might be worth mentioning around "EXPLAIN FORMATTED": with AQE, SQL "EXPLAIN" doesn't execute the query, so it only shows the initial plan rather...
- 1 kudos
- 42 Views
- 1 replies
- 1 kudos
New Databricks SQL window fuction: counter_diff
This function was designed to work with cumulative counters in time series. It automatically calculates the difference between the current and previous value, turning a cumulative counter into a per-period variation.Let's look at a practical example....
- 42 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
The counter_diff function is a significant upgrade over the traditional LAG() approach for IoT and telemetry data because it is "reset-aware."While a standard subtraction (Current - LAG(Previous)) produces a large negative number when a hardware coun...
- 1 kudos
- 48 Views
- 1 replies
- 0 kudos
Serverless DNS failures after trial upgrade (AWS us-east-2)
Our AWS Premium serverless workspace in us-east-2 cannot resolve several public domains. We added a payment method, and the account UI confirms that the trial upgrade is complete.Three fresh serverless notebook runs on September 24, 2026, at approxim...
- 48 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
My account Id: e5beacb1-d0a7-44cd-8de6-8d6f89d5af81
- 0 kudos
- 131 Views
- 7 replies
- 6 kudos
Resolved! Is Advanced edition required for Serverless pipeline?
I want to set Serverless pipeline with edition=PRO, but it raises the following error: cannot update pipeline: You must use the Advanced edition when using serverless compute.This is not specified anywhere in the documentation. It only says (see scr...
- 131 Views
- 7 replies
- 6 kudos
Latest Reply
- 6 kudos
Serverless DLT/Lakeflow pipelines currently mandate the "Advanced" edition.Even if you are not using Data Quality expectations (the most famous "Advanced" feature), the Serverless orchestration itself relies on advanced infrastructure management, enh...
- 6 kudos
- 118 Views
- 2 replies
- 0 kudos
I entered my credit card details 4 daysa go but i cant get access to openAI or Opus models
Even via the play ground i get this error:InternalError{"error_code":"PERMISSION_DENIED","message":"PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0."}It looks like most of the models are not activated f...
- 118 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hey @mikelben ! According to an official resolution provided by a Databricks Employee on the community forums, this specific "Permission_Deneid" error occurs when you are in the free/trial phase. The "rate limit of 0" is a backend restriction that ty...
- 0 kudos
- 96 Views
- 5 replies
- 0 kudos
Resolved! How to override ABAC policies
I'm struggling with the best way to handle ABAC inheritance. Here's the situation:We have tags deployed in table columns across a dozen catalogs and their schemas. In general, certain tags should have column masking policies applied so that our user ...
- 96 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
Awesome. Thank you both again, this is fairly simple to implement with our terraform code. You both gave great answers so I don't know who to accept as solution! I'll just pick the last response.Thanks again!
- 0 kudos
- 32 Views
- 0 replies
- 0 kudos
From Databricks POCs to Building a Data + AI Community
Over the last few years, I have spent a lot of time experimenting with one question: How do we turn Data + AI capabilities into applications people actually want to use?That curiosity led me to build multiple POCs and applications using Databricks + ...
- 32 Views
- 0 replies
- 0 kudos
- 62 Views
- 2 replies
- 1 kudos
Access to Lakehouse Real-Time (RT) in the preview tab
Hi Databricks team,we are currently doing an performance-centric assessment of Databricks and it would be great if we could also try the beta feature Lakehouse RT but this is not yet listed under the preview features. Is there any chance to get acces...
- 62 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @daniel_benchANT, Lakehouse//RT is currently in Beta, and it's gated, which is why you are not seeing it listed on the Previews page in your workspace yet. The feature only appears there after your Databricks account team has enabled it for your s...
- 1 kudos
- 76 Views
- 3 replies
- 0 kudos
Genie agent hyperlink creation
I have created a dasboard about a ticketing system, the business user use this dashboard with the genie agent integrated to this dashboard, sometimes they need to ask genie to create a table which contains the ticket id with the link of the related i...
- 76 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @koosha, Tried replicating this in my sandbox, on a small tickets and incidents dataset in a Genie space, and here is what I observed. When you ask Genie to show the ticket ID as a markdown link, it does put the right value in the cell. Whether th...
- 0 kudos
- 31 Views
- 0 replies
- 0 kudos
Lakebase Data API (GCP) returns jwk not found for valid service principal tokens
Workspace on GCP us-central1, Lakebase Autoscaling (Beta). The Data API returns 400 {"message":"jwk not found"} for every request.Setup follows the docs: role created with databricks_create_role('<sp-uuid>', 'SERVICE_PRINCIPAL'), GRANT "<sp-uuid>" TO...
- 31 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1442 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Multi-region model serving on Databricks with OpenSharing
Introduction Enterprises today serve customers across continents, from New York to Singapore, London to São Paulo. For these organizations, delivering fast, reliable user experiences is a business req...
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read. One way to improve the...
