The Genie has spoken And the winners of the Genie-Powered App Challenge are… A few weeks ago, we threw down a challenge: build something incredible with Databricks Apps and Genie Agent. And wow, you delivered. From smart, real-world prob...
- 1631 Views
- 11 replies
- 9 kudos
a week ago
Hey Databricks Community! Join us for a free community-sponsored BrickTalk on Thursday, September 24, 2026. BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Da...
- 239 Views
- 1 replies
- 2 kudos
Monday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1021 Views
- 0 replies
- 3 kudos
3 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 121614 Views
- 178 replies
- 60 kudos
a month ago
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 866 Views
- 0 replies
- 2 kudos
3 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 3242 Views
- 0 replies
- 3 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 610 Views
- 6 replies
- 7 kudos
Monday
Building a customer 360 requires connecting customer records across disparate data sets and establishing common customer identities. The Customer Entity Resolution Solution Accelerator shows how to build that foundation by translating customer attrib...
- 192 Views
- 0 replies
- 2 kudos
Tuesday
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 188 Views
- 0 replies
- 4 kudos
Thursday
Community Activity
- 104 Views
- 1 replies
- 0 kudos
Architectural Pattern for PII: "Redact at Ingestion" vs. "Dynamic Masking at Consumption
Hi everyone, we are defining our PII strategy in Unity Catalog. We are split on whether to: A) Redact/Hash PII at the Silver layer (permanent change), or B) Keep PII in Silver and use Dynamic Data Masking at the Gold/View layer.Does "Redact at Inges...
- 104 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Khasim_1, I would keep the PII in Silver within your regulatory and internal retention limits and control access with Unity Catalog's row filters and column masks, rather than redacting permanently. The reason is the one you already gave. A perma...
- 0 kudos
- 67167 Views
- 11 replies
- 28 kudos
Getting Started with Databricks - Building a Forecasting Model on Databricks
Building a Forecasting Model on Databricks: A Step-by-Step Guide This guide offers a detailed, step-by-step approach for building a forecasting model on Databricks. By leveraging the power of Databricks, you will unlock new potentials in your data w...
- 67167 Views
- 11 replies
- 28 kudos
- 116 Views
- 3 replies
- 0 kudos
Data ingestion: Setting up a connector for Postgres with CDC enabled.
Hello,I'm trying to ingest data from my RDS instance and set up change data capture on Databricks. Everything on the Postgres side has been done so that replication is possible, but CDC is still greyed out. I have asked Claude, Gemini, and ChatGPT. I...
- 116 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Quick question, being that my account is an individual account, how do I go about this "Contact your Databricks account team to request access"
- 0 kudos
- 29 Views
- 0 replies
- 0 kudos
Genie Ontology na prática
Databricks - Genie Ontology 吏 Se "receita" significa uma coisa para Vendas, outra para o Financeiro e uma terceira no ERP, o seu agente de IA vai escolher uma sozinho. E vai responder com a mesma confiança nos três casos.É esse o problema que o Geni...
- 29 Views
- 0 replies
- 0 kudos
- 6486 Views
- 9 replies
- 6 kudos
Resolved! Unexpected Script Execution Differences on databricks.com vs Mobile-Triggered Runtimes
I’m noticing some unusual inconsistencies in how scripts execute on databricks.com compared to when the same workflow is triggered through a mobile-based API. On Databricks, the script runs perfectly when executed directly inside a cluster notebook. ...
- 6486 Views
- 9 replies
- 6 kudos
Latest Reply
- 6 kudos
This kind of difference can be surprisingly easy to miss because the same notebook may behave differently depending on how it is launched. In Databricks, compute type, runtime, permissions, parameters, and whether the execution is interactive or a jo...
- 6 kudos
- 143 Views
- 2 replies
- 2 kudos
Power of Genie
Folks, I must admit, at the beginning I was apprehensive of using Genie for almost anything. Now it solves almost anything that I want to code on Databricks. I was more fascinated with it when I learnt that our customer (who is one of the largest Tel...
- 143 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Surya, good to read this, and I get the initial hesitation. We had the same reaction on our side a year ago.What changed the picture for us wasn't Genie getting smarter on its own, it was what we put around it. Once we added clear instructions per sp...
- 2 kudos
- 5016 Views
- 15 replies
- 9 kudos
Resolved! SCORM problem
I’m taking a course on the Databricks Academy, and the SCORM parts that are text-based don’t get completed. I read all the content until the end, but the lesson stays “in progress,” and because of that I can’t complete the course
- 5016 Views
- 15 replies
- 9 kudos
Latest Reply
- 9 kudos
When done with a SCORM document, instead of clicking on 'Next Lesson' click the 'Close' button. This fixed the issue for me.
- 9 kudos
- 122 Views
- 2 replies
- 2 kudos
Best practice to enforcing row-level security across multiple catalogs sharing same schema structure
Hi Everyone,We have identical schema structures replicated across three catalogs (dev, qa, prod) to support environment isolation. We now need to apply row-level security (e.g., restricting sales reps to only see their own region's data) consistently...
- 122 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Agree with @ThomazNeto - only thing I would add is your point 3 requirement: you could also consider using Terraform instead DABs or job for managing the ABAC policies across multiple environments. It does not support the beta features i.e. metastor...
- 2 kudos
- 114 Views
- 1 replies
- 0 kudos
Managing Row-Level Security (RLS) vs. Views: Performance impacts at scale
Hi everyone, we are designing our security layer in Unity Catalog. We are debating between using Row-Level Security (RLS) predicates versus standard SQL Views for masking PII data.When applying complex RLS predicates to tables with >100M rows, have ...
- 114 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Khasim,Most of this is answered directly in the Databricks docs, so let me point to what they say.1. Planning time vs. runtime. The docs don't describe a planning-time penalty; the cost is in what the optimizer is allowed to do. Both table-level r...
- 0 kudos
- 121 Views
- 1 replies
- 0 kudos
Managing "Secret" Injection in DABs across Dev/Stage/Prod
Hi everyone, I am fully moving our team to Databricks Asset Bundles (DABs) for CI/CD, but I’m struggling with the "Secret" management pattern.How are you handling the injection of secrets (like API keys for ingestion) into DABs without hardcoding any...
- 121 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Khasim,No secret value ever goes into databricks.yml. Bundle variables get resolved at deploy time and rendered into the job definition in the workspace, so anyone who can open the job can read them. Only names and references live in the bundle.Se...
- 0 kudos
- 98 Views
- 1 replies
- 0 kudos
ODBC v2.12- 503 "no Retry-After header"
I'm connecting to a Databricks catalog via a SQL Warehouse using the Databricks ODBC Driver (v2.12.0). During one of the fetches from my BI application, the transaction aborts with:Database operation [SQLExecute] failed with error [[Databricks][Hardy...
- 98 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi,I've hit this exact error in a few environments, so maybe this helps.First, the 503 itself is coming from the Databricks side, not from your BI tool or the driver. In every case I've traced it, the timestamps lined up with the SQL Warehouse being ...
- 0 kudos
- 203 Views
- 3 replies
- 0 kudos
Predictive Optimization for Streaming tables in Lakeflow pipelines
On July 2025 https://www.databricks.com/blog/whats-new-lakeflow-declarative-pipelines-july-2025 predictive optimization was enabled for all UC managed Lakeflow pipelines. I was wondering if there is a possibility now to disable it for Streaming table...
- 203 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Gilk, Before the how, can I ask what is driving the wish to turn it off? For most pipeline tables predictive optimization is doing useful work, running OPTIMIZE, VACUUM, and ANALYZE on serverless compute so file sizes, storage, and statistics sta...
- 0 kudos
- 340 Views
- 4 replies
- 4 kudos
Lakebase Postgres branch stuck "disabled" after auto-archive → unarchive (Public Preview)
Hi all,Running into what looks like a platform bug with Lakebase Postgres (Public Preview) and hoping a community engineer can help, since my Databricks support case (#01009170) was closed as out of entitlement (personal account, no support contract)...
- 340 Views
- 4 replies
- 4 kudos
Latest Reply
- 4 kudos
I also faced the same error as @jeremiasInetum. So I applied the steps from @Gokul_Pillai1 and status.disabled became false. After that, I navigate to branches in Lakebase. In branch overview, click on Protect button under Disable archiving.Click Se...
- 4 kudos
- 3716 Views
- 7 replies
- 22 kudos
Databricks Community Champion - May 2026 - Balaji J
Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individuals whose passion fo...
- 3716 Views
- 7 replies
- 22 kudos
- 56 Views
- 0 replies
- 2 kudos
How I explain account vs workspace vs Unity Catalog metastore to new platform engineers
Sharing the explanation that finally stopped the same question coming back every onboarding.The account is the organisation-level container, normally one per cloud provider, and it owns billing, account admins and identities. A workspace is a single ...
- 56 Views
- 0 replies
- 2 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1432 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read. One way to improve the...
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of mar...
