- 4664 Views
- 5 replies
- 12 kudos
Databricks Multi-Table Transactions - Part 1
If you've ever worked on an insurance data warehouse, or really any warehouse where data arrives from different systems at different times, you know the pain of keeping things in sync. I spent years building data warehouses for a property and casual...
- 4664 Views
- 5 replies
- 12 kudos
- 12 kudos
I know I'm reading this a bit late, but it's absolutely worth the read. Excellent write-up!Please share link for part-2
- 12 kudos
- 540 Views
- 0 replies
- 2 kudos
Building a Metadata-Driven ETL Framework on Databricks
Stop Writing ETL Code for Every New PipelineAs organizations modernize their data platforms, one challenge continues to appear repeatedly:Every new source requires another ETL job.Every new business rule requires another SQL update.Every schema chan...
- 540 Views
- 0 replies
- 2 kudos
- 1661 Views
- 0 replies
- 1 kudos
DataFlint on Databricks - the Open Source Spark UI Upgrade Apache Spark Has Needed for Years
IntroductionApache Spark has become one of the most widely adopted engines for large-scale data processing. Its appeal is easy to understand: it supports batch processing, streaming workloads, feature engineering, machine learning pipelines, and lar...
- 1661 Views
- 0 replies
- 1 kudos
- 2215 Views
- 2 replies
- 5 kudos
200,000 strong and just getting started. My Data and AI Summit 2026
Just back from Data and AI Summit 2026 and I am still buzzing.This was my best summit yet. Moscone was packed. More than 30,000 of us in one place, from over 150 countries, all there for the same reason. To build better with data and AI.The keynotes ...
- 2215 Views
- 2 replies
- 5 kudos
- 5 kudos
@Brahmareddy Thank you so much for your support of the Community! It was such a delight to see you at the Community booth and meet up in person. I'm looking forward to working with you as a Community Champion and making this an even better place for ...
- 5 kudos
- 3666 Views
- 0 replies
- 1 kudos
Databricks CustomerLake
Databricks CustomerLake: Inside the Agentic CDP Built for the Age of AIA deep dive into what CustomerLake actually is, how it works, and what it looks like in practice.At Data + AI Summit 2026, Databricks announced CustomerLake — an Agentic Customer ...
- 3666 Views
- 0 replies
- 1 kudos
- 786 Views
- 0 replies
- 0 kudos
Medallion Architecture Has 3 Layers. We Built 5. Here's Why — Views Layer Design on Databricks
Part 4 of my enterprise data platform series is up - this one cover why we added a fifth layer to the standard medallion architecture.We connected BI tools to the Gold layer and immediately hit four problems Gold alone couldn't solve:Schema breaks wh...
- 786 Views
- 0 replies
- 0 kudos
- 986 Views
- 0 replies
- 0 kudos
How a Partitioning Mistake Turned a 12-Minute Databricks Job Into a 2-Hour Nightmare
Hello Databricks Community!I recently published a detailed breakdown on Medium about a real-world optimization nightmare we faced, and I wanted to share the core lessons learned with this group.We had a highly efficient Delta table pipeline handling ...
- 986 Views
- 0 replies
- 0 kudos
- 165 Views
- 0 replies
- 0 kudos
Foresight — The Third Temporal Dimension of Delta Lake
Delta Lake gives you time travel backward:SELECT * FROM sales TIMESTAMP AS OF '2026-01-01'But what about forward? What will your Delta table look like next month?Nobody has built probabilistic future queries as a first-class Delta concept — until now...
- 165 Views
- 0 replies
- 0 kudos
- 7579 Views
- 0 replies
- 0 kudos
DAIS 2026: The Databricks Announcements I Think Clients Should Pay Attention To
The most important thing I took away from Data + AI Summit 2026 was not one product announcement.It was the direction.Databricks is building around a very real enterprise problem: companies want AI to help with decisions, operations, customer engagem...
- 7579 Views
- 0 replies
- 0 kudos
- 999 Views
- 1 replies
- 3 kudos
Power BI - DBX Unity catalog Lineage Syncer
Hi folks, So I have recently, as a side project been working on a tool, Link to my github: https://github.com/JeffDenzel/lineage-syncer.The problemThe reason for it is that DataBricks allows you to put external data assets into your UC. However, ther...
- 999 Views
- 1 replies
- 3 kudos
- 3 kudos
This is great work, Jeff!I have had my own share of pain with Power BI reports breaking because of column/name changes, so this problem feels very real.Linking Power BI semantic models back to Unity Catalog lineage sounds like a very useful directio...
- 3 kudos
- 1274 Views
- 0 replies
- 1 kudos
Your data is clean. But who's accessing it, and how? Governing your Lakehouse with Unity Catalog
Nobody told the analytics team they couldn't query the raw customer table. So, they did.Full names, email addresses, phone numbers - exported to a CSV for "a quick look." No alert fired. No one flagged it. We found out three weeks later during a comp...
- 1274 Views
- 0 replies
- 1 kudos
- 3295 Views
- 0 replies
- 1 kudos
The Comparison: Why the Alternatives Fall Short for Databricks-Native Agentic Systems
The OLTP architecture your agentic systems actually need, and how it compares to Supabase, Azure PostgreSQL, and Cosmos DBEarlier this year, Nikita Shamgunov — the engineer leading Databricks Lakebase — published a number that reframed my entire arch...
- 3295 Views
- 0 replies
- 1 kudos
- 504 Views
- 0 replies
- 0 kudos
Gold Layer Design on Databricks — MERGE vs Overwrite, Partitioning, SCD Type 2 from SAP
Part 3 of my series on building an enterprise data platform on Databricks is up - this one cover Gold layer design.The short version: Gold isn't just aggregated Silver. Silver maps to your source system. Gold maps to the business questions your consu...
- 504 Views
- 0 replies
- 0 kudos
- 362 Views
- 0 replies
- 0 kudos
How Aladdin Empowers Retail Leaders to Make Smarter Decisions Faster
The New Reality of Retail Leadership The retail industry has always been driven by customer preferences, operational efficiency, and the ability to adapt quickly to changing market conditions. However, today's retail landscape is more complex than ev...
- 362 Views
- 0 replies
- 0 kudos
- 778 Views
- 0 replies
- 2 kudos
Databricks AI/BI now supports custom visualizations [Public Preview]
Need a visualization type that Databricks doesn't support natively? Great, now with custom visualization, you are no longer limited to the built-in chart types.You can now define dashboard visuals using Vega-Lite JSON specifications, which opens the ...
- 778 Views
- 0 replies
- 2 kudos
| User | Count |
|---|---|
| 85 | |
| 75 | |
| 72 | |
| 60 | |
| 43 |
