The Genie has spoken And the winners of the Genie-Powered App Challenge are… A few weeks ago, we threw down a challenge: build something incredible with Databricks Apps and Genie Agent. And wow, you delivered. From smart, real-world prob...
- 1591 Views
- 11 replies
- 9 kudos
a week ago
Hey Databricks Community! Join us for a free community-sponsored BrickTalk on Thursday, September 24, 2026. BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Da...
- 221 Views
- 1 replies
- 2 kudos
Monday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 1000 Views
- 0 replies
- 3 kudos
3 weeks ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 118461 Views
- 172 replies
- 57 kudos
a month ago
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 846 Views
- 0 replies
- 2 kudos
3 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 3224 Views
- 0 replies
- 3 kudos
08-11-2026
Community Champion • Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individ...
- 581 Views
- 6 replies
- 7 kudos
Monday
Building a customer 360 requires connecting customer records across disparate data sets and establishing common customer identities. The Customer Entity Resolution Solution Accelerator shows how to build that foundation by translating customer attrib...
- 183 Views
- 0 replies
- 2 kudos
Tuesday
The Weekly Digest • September 7 – September 13 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week ...
- 171 Views
- 0 replies
- 4 kudos
Thursday
Community Activity
- 111 Views
- 2 replies
- 1 kudos
Power of Genie
Folks, I must admit, at the beginning I was apprehensive of using Genie for almost anything. Now it solves almost anything that I want to code on Databricks. I was more fascinated with it when I learnt that our customer (who is one of the largest Tel...
- 111 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Surya, good to read this, and I get the initial hesitation. We had the same reaction on our side a year ago.What changed the picture for us wasn't Genie getting smarter on its own, it was what we put around it. Once we added clear instructions per sp...
- 1 kudos
- 4990 Views
- 15 replies
- 9 kudos
Resolved! SCORM problem
I’m taking a course on the Databricks Academy, and the SCORM parts that are text-based don’t get completed. I read all the content until the end, but the lesson stays “in progress,” and because of that I can’t complete the course
- 4990 Views
- 15 replies
- 9 kudos
Latest Reply
- 9 kudos
When done with a SCORM document, instead of clicking on 'Next Lesson' click the 'Close' button. This fixed the issue for me.
- 9 kudos
- 89 Views
- 2 replies
- 2 kudos
Best practice to enforcing row-level security across multiple catalogs sharing same schema structure
Hi Everyone,We have identical schema structures replicated across three catalogs (dev, qa, prod) to support environment isolation. We now need to apply row-level security (e.g., restricting sales reps to only see their own region's data) consistently...
- 89 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Agree with @ThomazNeto - only thing I would add is your point 3 requirement: you could also consider using Terraform instead DABs or job for managing the ABAC policies across multiple environments. It does not support the beta features i.e. metastor...
- 2 kudos
- 77 Views
- 1 replies
- 0 kudos
Data ingestion: Setting up a connector for Postgres with CDC enabled.
Hello,I'm trying to ingest data from my RDS instance and set up change data capture on Databricks. Everything on the Postgres side has been done so that replication is possible, but CDC is still greyed out. I have asked Claude, Gemini, and ChatGPT. I...
- 77 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Wola,Don't worry about your Postgres side, that's most likely not the problem. The greyed-out option is coming from Databricks. The PostgreSQL CDC connector in Lakeflow Connect is still in Public Preview, and this one isn't self-service: the docs ...
- 0 kudos
- 95 Views
- 1 replies
- 0 kudos
Managing Row-Level Security (RLS) vs. Views: Performance impacts at scale
Hi everyone, we are designing our security layer in Unity Catalog. We are debating between using Row-Level Security (RLS) predicates versus standard SQL Views for masking PII data.When applying complex RLS predicates to tables with >100M rows, have ...
- 95 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Khasim,Most of this is answered directly in the Databricks docs, so let me point to what they say.1. Planning time vs. runtime. The docs don't describe a planning-time penalty; the cost is in what the optimizer is allowed to do. Both table-level r...
- 0 kudos
- 96 Views
- 1 replies
- 0 kudos
Managing "Secret" Injection in DABs across Dev/Stage/Prod
Hi everyone, I am fully moving our team to Databricks Asset Bundles (DABs) for CI/CD, but I’m struggling with the "Secret" management pattern.How are you handling the injection of secrets (like API keys for ingestion) into DABs without hardcoding any...
- 96 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Khasim,No secret value ever goes into databricks.yml. Bundle variables get resolved at deploy time and rendered into the job definition in the workspace, so anyone who can open the job can read them. Only names and references live in the bundle.Se...
- 0 kudos
- 52 Views
- 1 replies
- 0 kudos
ODBC v2.12- 503 "no Retry-After header"
I'm connecting to a Databricks catalog via a SQL Warehouse using the Databricks ODBC Driver (v2.12.0). During one of the fetches from my BI application, the transaction aborts with:Database operation [SQLExecute] failed with error [[Databricks][Hardy...
- 52 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi,I've hit this exact error in a few environments, so maybe this helps.First, the 503 itself is coming from the Databricks side, not from your BI tool or the driver. In every case I've traced it, the timestamps lined up with the SQL Warehouse being ...
- 0 kudos
- 167 Views
- 3 replies
- 0 kudos
Predictive Optimization for Streaming tables in Lakeflow pipelines
On July 2025 https://www.databricks.com/blog/whats-new-lakeflow-declarative-pipelines-july-2025 predictive optimization was enabled for all UC managed Lakeflow pipelines. I was wondering if there is a possibility now to disable it for Streaming table...
- 167 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Gilk, Before the how, can I ask what is driving the wish to turn it off? For most pipeline tables predictive optimization is doing useful work, running OPTIMIZE, VACUUM, and ANALYZE on serverless compute so file sizes, storage, and statistics sta...
- 0 kudos
- 319 Views
- 4 replies
- 4 kudos
Lakebase Postgres branch stuck "disabled" after auto-archive → unarchive (Public Preview)
Hi all,Running into what looks like a platform bug with Lakebase Postgres (Public Preview) and hoping a community engineer can help, since my Databricks support case (#01009170) was closed as out of entitlement (personal account, no support contract)...
- 319 Views
- 4 replies
- 4 kudos
Latest Reply
- 4 kudos
I also faced the same error as @jeremiasInetum. So I applied the steps from @Gokul_Pillai1 and status.disabled became false. After that, I navigate to branches in Lakebase. In branch overview, click on Protect button under Disable archiving.Click Se...
- 4 kudos
- 3700 Views
- 7 replies
- 22 kudos
Databricks Community Champion - May 2026 - Balaji J
Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individuals whose passion fo...
- 3700 Views
- 7 replies
- 22 kudos
- 42 Views
- 0 replies
- 2 kudos
How I explain account vs workspace vs Unity Catalog metastore to new platform engineers
Sharing the explanation that finally stopped the same question coming back every onboarding.The account is the organisation-level container, normally one per cloud provider, and it owns billing, account admins and identities. A workspace is a single ...
- 42 Views
- 0 replies
- 2 kudos
- 65 Views
- 0 replies
- 0 kudos
Property & Casualty Insurance Lakehouse
When building a Property & Casualty Insurance Lakehouse, one of the first things to understand is:A Claim is not just a Claim Amount.Consider a simple auto claim.At different points in the lifecycle, the same claim might have:Indemnity Reserve = $15,...
- 65 Views
- 0 replies
- 0 kudos
- 82 Views
- 0 replies
- 0 kudos
Accredible Badges not Issued for Partner Trainings Eligible for Badges
I am hoping to reach the Databricks support team with this. If this isn't the right way, someone please share a link to the correct channel I should use.I have completed the following e-learning which are supposed to grant Accredible badges, but the ...
- 82 Views
- 0 replies
- 0 kudos
- 993 Views
- 1 replies
- 0 kudos
Announcement | Introducing the Agentic CDP: Built for the AI Era
Databricks is introducing CustomerLake, an Agentic CDP built natively in Databricks to help marketing and data teams move from manual campaigns to more continuous, AI-driven customer engagement on a governed data foundation. What’s new Built for the ...
- 993 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Do you know how we, as partners, can get access to test this functionality, and whether it can be used in production by our clients on their own portals? If so, what would the process look like?Thank you!
- 0 kudos
- 212 Views
- 4 replies
- 0 kudos
Lakeflow connect CT pipeline keeps running multiple connections in source
I'm working on an ingestion pipeline. I was adding tables to it gradually so that we can monitor the load on our prod server side by side and with my last set of tables added (with them, all the heavy duty tables were inside that pipeline), the load ...
- 212 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
For a standard connector, the gateway continuously extracts snapshots, change logs, and metadata, while a separately scheduled serverless pipeline applies staged data (connector components). Changing the serverless pipeline schedule therefore does no...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1427 | |
| 1253 | |
| 1187 | |
| 961 |
Latest from our Blog
Tutorial: Databricks Genie for Data Engineers and Data Scientists
Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scien...
Beyond the Dashboard: How Transferz Built a Truly Data-Driven Company Culture With AI/BI Genie
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read. One way to improve the...
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of mar...
