Stop Writing ETL Code for Every New PipelineAs organizations modernize their data platforms, one challenge continues to appear repeatedly:Every new source requires another ETL job.Every new business rule requires another SQL update.Every schema chan...
IntroductionApache Spark has become one of the most widely adopted engines for large-scale data processing. Its appeal is easy to understand: it supports batch processing, streaming workloads, feature engineering, machine learning pipelines, and lar...
The new Databricks Certified Context Engineer Associate beta exam is not a typical certification exam.I took it during Data + AI Summit 2026, and my first reaction was simple: this is a serious exam.I have completed seven Databricks certifications so...
Detailed, incisive exam review. Thanks for sharing @mou
I have spent the past couple of months building up a small hobby YouTube project where I run through Databricks Features in an easy to digest format.I am for a very hands-on and demo heavy approach so you can actually see what is going on, and how th...
The next video is ready!ImportBI is a new skill added to Genie that allows you to speed up migration from PowerBI and Tableau to Databricks. This time we look at a simple model - but stay tuned (... and subscribe!) for a deep dive on a larger model n...
How Databricks’ AI agent transforms data engineering from manual craftsmanship into conversational pipeline development Data engineers have long accepted a painful truth: building production-grade ETL pipelines means wrestling with hundreds ...
Great Overview, Thanks for sharing with the community.
Just back from Data and AI Summit 2026 and I am still buzzing.This was my best summit yet. Moscone was packed. More than 30,000 of us in one place, from over 150 countries, all there for the same reason. To build better with data and AI.The keynotes ...
@Brahmareddy Thank you so much for your support of the Community! It was such a delight to see you at the Community booth and meet up in person. I'm looking forward to working with you as a Community Champion and making this an even better place for ...
This is part 3 of 3 in a series where I take you through working with Metric Views.Part 1: Introduction to Metric ViewsPart 2: Metric Views and the Databricks platform (AI/BI Dashboards, Genie, etc.)Part 3: Metric Views with Power BI and Tabular Edit...
@nikhil-dbx as far as I understand that feature the idea is to provide a multi-fact pattern for Dashboards specifically for now.I am yet to get my hands on the preview for Dashboard Relationships as they are called. I will update with a new article ...
Databricks CustomerLake: Inside the Agentic CDP Built for the Age of AIA deep dive into what CustomerLake actually is, how it works, and what it looks like in practice.At Data + AI Summit 2026, Databricks announced CustomerLake — an Agentic Customer ...
With Genie Code, you can now add a Tableau or Power BI file and have it build an AI/BI dashboard that replicates your existing visualizations - while connecting them to metric views that mirror the underlying business logic.Import BI files using Geni...
How does databricks handle calculated fields etc In TWB files they are referenced as calculation_1234.... does databricks store these references at the data model level to resolve them when I upload a TWB file
Part 4 of my enterprise data platform series is up - this one cover why we added a fifth layer to the standard medallion architecture.We connected BI tools to the Gold layer and immediately hit four problems Gold alone couldn't solve:Schema breaks wh...
Hello Databricks Community!I recently published a detailed breakdown on Medium about a real-world optimization nightmare we faced, and I wanted to share the core lessons learned with this group.We had a highly efficient Delta table pipeline handling ...
Delta Lake gives you time travel backward:SELECT * FROM sales TIMESTAMP AS OF '2026-01-01'But what about forward? What will your Delta table look like next month?Nobody has built probabilistic future queries as a first-class Delta concept — until now...
The most important thing I took away from Data + AI Summit 2026 was not one product announcement.It was the direction.Databricks is building around a very real enterprise problem: companies want AI to help with decisions, operations, customer engagem...
Hi folks, So I have recently, as a side project been working on a tool, Link to my github: https://github.com/JeffDenzel/lineage-syncer.The problemThe reason for it is that DataBricks allows you to put external data assets into your UC. However, ther...
This is great work, Jeff!I have had my own share of pain with Power BI reports breaking because of column/name changes, so this problem feels very real.Linking Power BI semantic models back to Unity Catalog lineage sounds like a very useful directio...
Nobody told the analytics team they couldn't query the raw customer table. So, they did.Full names, email addresses, phone numbers - exported to a CSV for "a quick look." No alert fired. No one flagged it. We found out three weeks later during a comp...
| User | Count |
|---|---|
| 85 | |
| 75 | |
| 67 | |
| 63 | |
| 44 |
