- 2393 Views
- 4 replies
- 4 kudos
From Learning to Enablement: My 2025 Databricks Journey
Celebrating platform capabilities, community impact, and responsible adoptionIn 2025, my Databricks journey evolved from mastering features to empowering outcomes.What became clear this year is that Databricks isn’t just a powerful platform — it’s a ...
- 2393 Views
- 4 replies
- 4 kudos
- 4 kudos
Nice write-up @Lakshmipriya_Na , I really like this framing. The “Builder” vs “Strategist” distinction maps almost perfectly to how Databricks shows up in the real world. You can move fast and iterate in notebooks, but the same Lakehouse naturally n...
- 4 kudos
- 569 Views
- 0 replies
- 1 kudos
Databricks Advent Calendar 2025 #23
Our calendar is coming to an end. One of the most significant innovations of last year is Agent Bricks. We received a few ready-made solutions for deploying agents. As the Agents ecosystem becomes more complex, one of my favourites is the Multi-Agent...
- 569 Views
- 0 replies
- 1 kudos
- 539 Views
- 0 replies
- 1 kudos
Databricks Advent Calendar 2025 #22
During the last two weeks, five new Lakeflow Connect connectors were announced. It allows incremental ingestion of the data in an easy way. In the coming weeks, there will be more announcements about Lakeflow Connect, and we can expect Databricks to ...
- 539 Views
- 0 replies
- 1 kudos
- 585 Views
- 0 replies
- 1 kudos
Databricks Advent Calendar 2025 #21
Your stream can have a state, and now, with TransformWithStateInPandas, it’s easy to manage - you can handle things like initial state, deduplication, recovery, etc., with the 2025 improvements.
- 585 Views
- 0 replies
- 1 kudos
- 724 Views
- 0 replies
- 1 kudos
Databricks Advent Calendar 2025 #20
As Unity Catalog becomes an enterprise catalog, bring-your-own lineage is one of my favorite features.
- 724 Views
- 0 replies
- 1 kudos
- 647 Views
- 0 replies
- 1 kudos
Databricks Advent Calendar 2025 #19
In 2025, Metrics Views are becoming the standard way to define business logic once and reuse it everywhere. Instead of repeating complex SQL, teams can work with clean, consistent metrics.
- 647 Views
- 0 replies
- 1 kudos
- 767 Views
- 1 replies
- 2 kudos
Databricks Advent Calendar 2025 #18
Automatic file retention in the autoloader is one of my favourite new features of 2025. Automatically move cloud files to cold storage or just delete.
- 767 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks for sharing @Hubert-Dudek ! That's a really great feature. It simplified a lot data maintenance process at one of my clients
- 2 kudos
- 2447 Views
- 3 replies
- 22 kudos
Training That Scales: How Databricks Adoption Really Takes Hold
I teach Databricks to all sorts of folks, coders, managers—everyone. What’s wild is how two companies with the same setup can have totally different experiences. Usually, it’s not the tech itself that’s the issue, but how people see it. Databricks tr...
- 2447 Views
- 3 replies
- 22 kudos
- 22 kudos
As someone who benefited from Louis Training, I can attest that it makes a difference to constantly keep up to date and work on the foundation of understanding.Especially when things move so fast as in our industry, the time to reflect and improve pa...
- 22 kudos
- 10497 Views
- 8 replies
- 8 kudos
Cross-filtering for AI/BI dashboards
AI/BI dashboards now support cross-filtering, which allows you to click on an element in one chart to filter and update related data in other charts.Cross-filtering allows users to interactively explore relationships and patterns across multiple visu...
- 10497 Views
- 8 replies
- 8 kudos
- 8 kudos
There does appear to now be a list of capsules indicating the filters applied along the top of Databricks AI/BI Dashboards. The capsules appear to include filter-selectors and also cross-filters added by clicking charts.Also, there is a now "Reset t...
- 8 kudos
- 510 Views
- 0 replies
- 2 kudos
Databricks Advent Calendar 2025 #17
Replacing records for the entire date with newly arriving data for the given date is a typical design pattern. Now, thanks to simple REPLACE USING in Databricks, it is easier than ever!
- 510 Views
- 0 replies
- 2 kudos
- 958 Views
- 2 replies
- 3 kudos
Databricks Advent Calendar 2025 #11
Real-time mode is a breakthrough that lets Spark utilize all available CPUs to process records with single-millisecond latency, while decoupling checkpointing from per-record processing.
- 958 Views
- 2 replies
- 3 kudos
- 596 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #16
For many data engineers who love PySpark, the most significant improvement of 2025 was the addition of merge to the dataframe API, so no more Delta library or SQL is needed to perform MERGE. p.s. I still prefer SQL MERGE inside spark.sql()
- 596 Views
- 0 replies
- 0 kudos
- 628 Views
- 0 replies
- 2 kudos
Databricks Advent Calendar 2025 #15
New Lakakebase experience is a game-changer for transactional databases. That functionality is fantastic. Autoscaling to zero makes it really cost-effective. Do you need to deploy to prod? Just branch the production database to the release branch, an...
- 628 Views
- 0 replies
- 2 kudos
- 6966 Views
- 1 replies
- 3 kudos
Unity Catalog Lineage: Lineage That Just Works
I've been working with Unity Catalog's lineage capabilities for a while now, and I have to say—this is what lineage should have always been. Not a separate tool to configure. Not a manual process to maintain. Just automatic, real-time visibility into...
- 6966 Views
- 1 replies
- 3 kudos
- 3 kudos
I have been using and implementing UC in various workspaces across industry, BYOL is the one I am really looking forward to implement next.Thanks @AbhaySingh for consolidating it here.
- 3 kudos
- 583 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #14
Ingestion from SharePoint is now available directly in PySpark. Just define a connection and use spark-read or, even better, spark-readStream with an autoloader. Just specify the file type and options for that file (pdf, csv, Excel, etc.)
- 583 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 85 | |
| 76 | |
| 73 | |
| 60 | |
| 43 |
