- 2873 Views
- 11 replies
- 32 kudos
A small song for the Databricks Community
One Question Can Light the SparkMy Databricks journey started in 2022 with simple interest, curiosity, and a dream to learn more.At that time, I was just trying to understand the platform, follow the updates, learn from others, and slowly build my co...
- 2873 Views
- 11 replies
- 32 kudos
- 32 kudos
My turn! (couldn't let this disappear from the homepage that quickly ).This one is officially going down in Community history now, @Brahmareddy .
- 32 kudos
- 6145 Views
- 5 replies
- 12 kudos
Databricks Multi-Table Transactions - Part 1
If you've ever worked on an insurance data warehouse, or really any warehouse where data arrives from different systems at different times, you know the pain of keeping things in sync. I spent years building data warehouses for a property and casual...
- 6145 Views
- 5 replies
- 12 kudos
- 12 kudos
I know I'm reading this a bit late, but it's absolutely worth the read. Excellent write-up!Please share link for part-2
- 12 kudos
- 812 Views
- 0 replies
- 2 kudos
Building a Metadata-Driven ETL Framework on Databricks
Stop Writing ETL Code for Every New PipelineAs organizations modernize their data platforms, one challenge continues to appear repeatedly:Every new source requires another ETL job.Every new business rule requires another SQL update.Every schema chan...
- 812 Views
- 0 replies
- 2 kudos
- 2300 Views
- 0 replies
- 1 kudos
DataFlint on Databricks - the Open Source Spark UI Upgrade Apache Spark Has Needed for Years
IntroductionApache Spark has become one of the most widely adopted engines for large-scale data processing. Its appeal is easy to understand: it supports batch processing, streaming workloads, feature engineering, machine learning pipelines, and lar...
- 2300 Views
- 0 replies
- 1 kudos
- 2591 Views
- 2 replies
- 5 kudos
200,000 strong and just getting started. My Data and AI Summit 2026
Just back from Data and AI Summit 2026 and I am still buzzing.This was my best summit yet. Moscone was packed. More than 30,000 of us in one place, from over 150 countries, all there for the same reason. To build better with data and AI.The keynotes ...
- 2591 Views
- 2 replies
- 5 kudos
- 5 kudos
@Brahmareddy Thank you so much for your support of the Community! It was such a delight to see you at the Community booth and meet up in person. I'm looking forward to working with you as a Community Champion and making this an even better place for ...
- 5 kudos
- 1066 Views
- 0 replies
- 0 kudos
Medallion Architecture Has 3 Layers. We Built 5. Here's Why — Views Layer Design on Databricks
Part 4 of my enterprise data platform series is up - this one cover why we added a fifth layer to the standard medallion architecture.We connected BI tools to the Gold layer and immediately hit four problems Gold alone couldn't solve:Schema breaks wh...
- 1066 Views
- 0 replies
- 0 kudos
- 1160 Views
- 0 replies
- 0 kudos
How a Partitioning Mistake Turned a 12-Minute Databricks Job Into a 2-Hour Nightmare
Hello Databricks Community!I recently published a detailed breakdown on Medium about a real-world optimization nightmare we faced, and I wanted to share the core lessons learned with this group.We had a highly efficient Delta table pipeline handling ...
- 1160 Views
- 0 replies
- 0 kudos
- 282 Views
- 0 replies
- 0 kudos
Foresight — The Third Temporal Dimension of Delta Lake
Delta Lake gives you time travel backward:SELECT * FROM sales TIMESTAMP AS OF '2026-01-01'But what about forward? What will your Delta table look like next month?Nobody has built probabilistic future queries as a first-class Delta concept — until now...
- 282 Views
- 0 replies
- 0 kudos
- 10080 Views
- 0 replies
- 0 kudos
DAIS 2026: The Databricks Announcements I Think Clients Should Pay Attention To
The most important thing I took away from Data + AI Summit 2026 was not one product announcement.It was the direction.Databricks is building around a very real enterprise problem: companies want AI to help with decisions, operations, customer engagem...
- 10080 Views
- 0 replies
- 0 kudos
- 1343 Views
- 1 replies
- 3 kudos
Power BI - DBX Unity catalog Lineage Syncer
Hi folks, So I have recently, as a side project been working on a tool, Link to my github: https://github.com/JeffDenzel/lineage-syncer.The problemThe reason for it is that DataBricks allows you to put external data assets into your UC. However, ther...
- 1343 Views
- 1 replies
- 3 kudos
- 3 kudos
This is great work, Jeff!I have had my own share of pain with Power BI reports breaking because of column/name changes, so this problem feels very real.Linking Power BI semantic models back to Unity Catalog lineage sounds like a very useful directio...
- 3 kudos
- 1672 Views
- 0 replies
- 1 kudos
Your data is clean. But who's accessing it, and how? Governing your Lakehouse with Unity Catalog
Nobody told the analytics team they couldn't query the raw customer table. So, they did.Full names, email addresses, phone numbers - exported to a CSV for "a quick look." No alert fired. No one flagged it. We found out three weeks later during a comp...
- 1672 Views
- 0 replies
- 1 kudos
- 4162 Views
- 0 replies
- 1 kudos
The Comparison: Why the Alternatives Fall Short for Databricks-Native Agentic Systems
The OLTP architecture your agentic systems actually need, and how it compares to Supabase, Azure PostgreSQL, and Cosmos DBEarlier this year, Nikita Shamgunov — the engineer leading Databricks Lakebase — published a number that reframed my entire arch...
- 4162 Views
- 0 replies
- 1 kudos
- 674 Views
- 0 replies
- 0 kudos
Gold Layer Design on Databricks — MERGE vs Overwrite, Partitioning, SCD Type 2 from SAP
Part 3 of my series on building an enterprise data platform on Databricks is up - this one cover Gold layer design.The short version: Gold isn't just aggregated Silver. Silver maps to your source system. Gold maps to the business questions your consu...
- 674 Views
- 0 replies
- 0 kudos
- 477 Views
- 0 replies
- 0 kudos
How Aladdin Empowers Retail Leaders to Make Smarter Decisions Faster
The New Reality of Retail Leadership The retail industry has always been driven by customer preferences, operational efficiency, and the ability to adapt quickly to changing market conditions. However, today's retail landscape is more complex than ev...
- 477 Views
- 0 replies
- 0 kudos
- 985 Views
- 0 replies
- 2 kudos
Databricks AI/BI now supports custom visualizations [Public Preview]
Need a visualization type that Databricks doesn't support natively? Great, now with custom visualization, you are no longer limited to the built-in chart types.You can now define dashboard visuals using Vega-Lite JSON specifications, which opens the ...
- 985 Views
- 0 replies
- 2 kudos
| User | Count |
|---|---|
| 85 | |
| 76 | |
| 73 | |
| 60 | |
| 43 |
