- 565 Views
- 1 replies
- 2 kudos
Databricks Advent Calendar 2025 #18
Automatic file retention in the autoloader is one of my favourite new features of 2025. Automatically move cloud files to cold storage or just delete.
- 565 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks for sharing @Hubert-Dudek ! That's a really great feature. It simplified a lot data maintenance process at one of my clients
- 2 kudos
- 1707 Views
- 3 replies
- 22 kudos
Training That Scales: How Databricks Adoption Really Takes Hold
I teach Databricks to all sorts of folks, coders, managers—everyone. What’s wild is how two companies with the same setup can have totally different experiences. Usually, it’s not the tech itself that’s the issue, but how people see it. Databricks tr...
- 1707 Views
- 3 replies
- 22 kudos
- 22 kudos
As someone who benefited from Louis Training, I can attest that it makes a difference to constantly keep up to date and work on the foundation of understanding.Especially when things move so fast as in our industry, the time to reflect and improve pa...
- 22 kudos
- 8716 Views
- 8 replies
- 7 kudos
Cross-filtering for AI/BI dashboards
AI/BI dashboards now support cross-filtering, which allows you to click on an element in one chart to filter and update related data in other charts.Cross-filtering allows users to interactively explore relationships and patterns across multiple visu...
- 8716 Views
- 8 replies
- 7 kudos
- 7 kudos
There does appear to now be a list of capsules indicating the filters applied along the top of Databricks AI/BI Dashboards. The capsules appear to include filter-selectors and also cross-filters added by clicking charts.Also, there is a now "Reset t...
- 7 kudos
- 369 Views
- 0 replies
- 2 kudos
Databricks Advent Calendar 2025 #17
Replacing records for the entire date with newly arriving data for the given date is a typical design pattern. Now, thanks to simple REPLACE USING in Databricks, it is easier than ever!
- 369 Views
- 0 replies
- 2 kudos
- 688 Views
- 2 replies
- 3 kudos
Databricks Advent Calendar 2025 #11
Real-time mode is a breakthrough that lets Spark utilize all available CPUs to process records with single-millisecond latency, while decoupling checkpointing from per-record processing.
- 688 Views
- 2 replies
- 3 kudos
- 439 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #16
For many data engineers who love PySpark, the most significant improvement of 2025 was the addition of merge to the dataframe API, so no more Delta library or SQL is needed to perform MERGE. p.s. I still prefer SQL MERGE inside spark.sql()
- 439 Views
- 0 replies
- 0 kudos
- 448 Views
- 0 replies
- 2 kudos
Databricks Advent Calendar 2025 #15
New Lakakebase experience is a game-changer for transactional databases. That functionality is fantastic. Autoscaling to zero makes it really cost-effective. Do you need to deploy to prod? Just branch the production database to the release branch, an...
- 448 Views
- 0 replies
- 2 kudos
- 4774 Views
- 1 replies
- 3 kudos
Unity Catalog Lineage: Lineage That Just Works
I've been working with Unity Catalog's lineage capabilities for a while now, and I have to say—this is what lineage should have always been. Not a separate tool to configure. Not a manual process to maintain. Just automatic, real-time visibility into...
- 4774 Views
- 1 replies
- 3 kudos
- 3 kudos
I have been using and implementing UC in various workspaces across industry, BYOL is the one I am really looking forward to implement next.Thanks @AbhaySingh for consolidating it here.
- 3 kudos
- 435 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #14
Ingestion from SharePoint is now available directly in PySpark. Just define a connection and use spark-read or, even better, spark-readStream with an autoloader. Just specify the file type and options for that file (pdf, csv, Excel, etc.)
- 435 Views
- 0 replies
- 0 kudos
- 1095 Views
- 0 replies
- 1 kudos
Databricks News: Week 50: 8 December 2025 to 14 December 2025
Excel The big news this week is the possibility of native importing Excel files. Write operations are also possible. There is a possibility of choosing a data range. It also works with the streaming autoloader, currently in beta. GPT 5.2 The same day...
- 1095 Views
- 0 replies
- 1 kudos
- 465 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #13
ZeroBus changes the game: you can now push event data directly into Databricks, even from on-prem. No extra event layer needed. Every Unity Catalog table can act as an endpoint.
- 465 Views
- 0 replies
- 0 kudos
- 477 Views
- 0 replies
- 1 kudos
Databricks Advent Calendar 2025 #12
All leading LLMs are available natively in Databricks: - ChatGPT 5.2 from the day of the premiere! - System catalog with AI schema in Unity Catalog has multiple LLMs ready to serve! - OpenAI, Gemini, and Anthropic are available side by side!
- 477 Views
- 0 replies
- 1 kudos
- 449 Views
- 0 replies
- 2 kudos
Databricks Advent Calendar 2025 #10
Databricks goes native on Excel. You can now ingest + query .xls/.xlsx directly in Databricks (SQL + PySpark, batch and streaming), with auto schema/type inference, sheet + cell-range targeting, and evaluated formulas, no extra libraries anymore.
- 449 Views
- 0 replies
- 2 kudos
- 375 Views
- 0 replies
- 2 kudos
Databricks Advent Calendar 2025 #9
Tags, whether manually assigned or automatically assigned by the “data classification” service, can be protected using policies. Column masking can automatically mask columns with a given tag for all except some with elevated access.
- 375 Views
- 0 replies
- 2 kudos
- 1256 Views
- 1 replies
- 1 kudos
Building an AgenticLakehouse: Interacting with Databricks Workspace via LangGraph and MCP
This project, AgenticLakehouse, explores the cutting edge of "Agentic Data Analytics." I didn't just want a chatbot; I wanted a "living" interface for the Lakehouse. The result is a Multi-Agent System that intelligently orchestrates tasks, from query...
- 1256 Views
- 1 replies
- 1 kudos
- 1 kudos
Looks great, solid LangGraph + MCP setup on Databricks Apps. Thanks for sharing, @vinaygazula!
- 1 kudos
| User | Count |
|---|---|
| 85 | |
| 74 | |
| 58 | |
| 44 | |
| 44 |
