The Genie has spoken And the winners of the Genie-Powered App Challenge are… A few weeks ago, we threw down a challenge: build something incredible with Databricks Apps and Genie Agent. And wow, you delivered. From smart, real-world prob...
- 675 Views
- 9 replies
- 7 kudos
yesterday
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, September 17, 2026! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with d...
- 292 Views
- 0 replies
- 2 kudos
Monday
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 632 Views
- 0 replies
- 2 kudos
a week ago
Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...
- 46983 Views
- 59 replies
- 39 kudos
3 weeks ago
Virtual Event Time: AMER Sept 23 / 9 AM PTEMEA Sept 24 / 9 AM BST / 10 AM CESTAPJ Sept 24 / 9:30 AM IST / 12 PM SGT / 1 PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: Marking RSVP on this Community ...
- 477 Views
- 0 replies
- 2 kudos
a week ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 2629 Views
- 0 replies
- 3 kudos
08-11-2026
Product onboarding can be complex and time-consuming when teams work with inconsistent data formats, inaccurate information and multiple stakeholders. The Simplifying Product Onboarding With Generative AI Solution Accelerator shows how generative AI ...
- 86 Views
- 0 replies
- 0 kudos
Tuesday
The Weekly Digest • August 31 – September 6 Community Pulse Your weekly pulse: new articles, real answers, and the discussions worth watching. This Week's Community Stars This week's difference-makers – and a shout-out to the new members ear...
- 242 Views
- 0 replies
- 1 kudos
Tuesday
Community Activity
- 19 Views
- 0 replies
- 0 kudos
Delta Executor: Things to Check Before Using a Roblox Tool
Delta Executor: Things to Check Before Using a Roblox ToolWhen looking into third-party Roblox tools, I think it’s better to understand what you’re dealing with before installing anything. Version changes, device compatibility, source reliability, an...
- 19 Views
- 0 replies
- 0 kudos
- 108 Views
- 0 replies
- 0 kudos
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of martech sources, including ad connectors like Google ...
- 108 Views
- 0 replies
- 0 kudos
- 675 Views
- 9 replies
- 27 kudos
Databricks Community Contest | Winners of the Genie-Powered App Challenge!
The Genie has spoken And the winners of the Genie-Powered App Challenge are… A few weeks ago, we threw down a challenge: build something incredible with Databricks Apps and Genie Agent. And wow, you delivered. From smart, real-world prob...
- 675 Views
- 9 replies
- 27 kudos
Latest Reply
- 27 kudos
Really happy to see ChicagoPulse win Gold in Track A!Thank you to the Databricks Community, the judges, and everyone who put the Genie Powered App Challenge together. I had a lot of fun building this and working on a real Chicago civic data use case....
- 27 kudos
- 39 Views
- 0 replies
- 0 kudos
Broken x-axis sort order in combo chart
Hello. I am using the Combo Chart to create a Pareto visual. I have an SQL query with built-in ordering, with output like: categorysort_ordercategory_countcumulative_pct1SQL15229.92Python23922.43R32112.14.Net4169.25Bash584.66All Others63821.8That's...
- 39 Views
- 0 replies
- 0 kudos
- 231 Views
- 0 replies
- 0 kudos
Meet SDP Rewind: An undo button for your ETL pipelines
It's Saturday morning, and your phone goes off. A deployment that shipped Friday afternoon has been quietly writing bad data into your pipeline ever since, and now downstream dashboards are wrong. So you spend your weekend figuring out how far back t...
- 231 Views
- 0 replies
- 0 kudos
- 76 Views
- 0 replies
- 2 kudos
Announcing Databricks AppQuest: Hands-On Guidance and Cash Prizes for APJ Developers
SINGAPORE, [DATE] 2026, Databricks and AngelHack today announced Databricks AppQuest, a five-quest learning program that helps developers across Asia Pacific and Japan (APAC) build and ship working AI applications faster - taking them from an idea to...
- 76 Views
- 0 replies
- 2 kudos
- 1844 Views
- 3 replies
- 3 kudos
Identity Columns Best Practices for Databricks Lakehouse
The surrogate key problem nobody plans for Sooner or later every data warehouse needs surrogate keys. You are building a dimension table and you want a single narrow column your fact tables can join on instead of a wide composite of source attributes...
- 1844 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
In our architecture, in gold we are using materialized views for dimensions. How to generate surrogate key for them? as they don't support Identity columns
- 3 kudos
- 59 Views
- 0 replies
- 0 kudos
CUSTOMER STORY | Siemens Healthineers modernizes MRI scanner data on Databricks
“A straight move to the cloud would have cost two to four times more, so we would never have done it. The design with Databricks came out cheaper, and now we get the AI capabilities on top.” - Michae...
- 59 Views
- 0 replies
- 0 kudos
- 81 Views
- 3 replies
- 0 kudos
Auto Loader stream fails on RocksDB checkpoint after enabling managed file events
Hello Community.We recently enabled the following option on several existing Auto Loader streams:"cloudFiles.useManagedFileEvents": "true"Most streams continued working, but one now fails while restoring its existing checkpoint, referencing a file si...
- 81 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
I am really glad to hear you got the stream unblocked.Thank you for sharing the exact error code (FAILED_READ_FILE.NO_HINT). That makes perfect sense—if the RocksDB .zip archive itself is physically unreadable or corrupted at the storage layer, rathe...
- 0 kudos
- 53 Views
- 1 replies
- 0 kudos
CSV export from AI/BI Dashboard table widget does not preserve visual column order
SummaryWhen downloading data as CSV from a table widget on an AI/BI Dashboard (kebab menu → Download → Data → Download CSV), the column order in the exported file does not match the column order displayed in the dashboard. All aggregated (measure) co...
- 53 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I had a go at reproducing this on a current AI/BI build and couldn't get a plain table widget to misbehave. I built a table grouping dimensions plus sum(...) measures, arranged dimensions-first, and the exported CSV kept that order every time. I test...
- 0 kudos
- 80 Views
- 1 replies
- 0 kudos
OAuth M2M (client-credentials) - getting error with github run
I'm setting up OAuth M2M (client-credentials) authentication for a service principal, as the long-term replacement for PAT-based auth in a GitHub Actions CI/CD workflow. The token exchange itself succeeds and returns a valid, well-formed access token...
- 80 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
further refined this problem with below if anyone has any idea how I could address? thanks. Later in troubleshooting, this same should_change_password error started appearing on a personal-account PAT as well (not just the SP's OAuth token) — so what...
- 0 kudos
- 77 Views
- 1 replies
- 2 kudos
Resolved! Best Practice for Handling Schema Evolution with Auto Loader in Production?
Hi Databricks Community,I’d like to hear how other Data Engineers are handling schema evolution with Auto Loader in production environments.Consider the following scenario:We have a continuously running ingestion pipeline using Auto Loader that proce...
- 77 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @Islam_hoti,This is a central design decision for any production-grade Lakehouse. In my experience architecting petabyte-scale environments, the goal is to minimize "Pipeline Friction" without sacrificing "Data Governance."Here is the "Architectur...
- 2 kudos
- 43 Views
- 0 replies
- 0 kudos
Announcement | Autoscaling Lakebase Postgres
Choosing a fixed database size before you know the workload is an old pattern. Lakebase Postgres removes that sizing exercise by continuously adjusting compute to match demand, while keeping PostgreSQL running and the data safely decoupled in the sto...
- 43 Views
- 0 replies
- 0 kudos
- 58 Views
- 1 replies
- 0 kudos
Getting started with Delta Lake basics
Hi all — I am working through the Delta Lake intro and wanted to share a short note on using OPTIMIZE after merge. Happy to hear better patterns.
- 58 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Did you forgot to share the short note? If you are referring to running optimize after Merge, its worth mentioning that it doesn't need to be run after every Merge.MERGE can create or rewrite files, but whether OPTIMIZE is needed immediately depends ...
- 0 kudos
- 43 Views
- 0 replies
- 0 kudos
Changing Root Metastore Location
We currently have a default root metastore location linked to an ADLS container.At the same time we are working on a ADLS migration project.All of the tables and files (everything we use for day to day business related) have moved to the new ADLS so ...
- 43 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1406 | |
| 1253 | |
| 1186 | |
| 961 |
Latest from our Blog
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of mar...
Meet SDP Rewind: An undo button for your ETL pipelines
It's Saturday morning, and your phone goes off. A deployment that shipped Friday afternoon has been quietly writing bad data into your pipeline ever since, and now downstream dashboards are wrong. So ...
Actually understanding Unity Catalog Managed Tables
The “why” worth knowing Choosing external tables is usually about flexibility: you keep dedicated storage, maintain raw files that multiple engines can query directly, and control your own partitionin...
Introducing Stream-Stream Join Support in Apache Spark Real-Time Mode
Summary Explore how Real-Time Mode for Apache Spark Structured Streaming on Databricks now supports inner stream-stream joins in update mode — with sub-second latency.See it in action on a real-time a...
