- 71 Views
- 2 replies
- 1 kudos
From Learning to Enablement: My 2025 Databricks Journey
Celebrating platform capabilities, community impact, and responsible adoptionIn 2025, my Databricks journey evolved from mastering features to empowering outcomes.What became clear this year is that Databricks isn’t just a powerful platform — it’s a ...
- 71 Views
- 2 replies
- 1 kudos
- 1 kudos
Nice write-up @Lakshmipriya , I really like this framing. The “Builder” vs “Strategist” distinction maps almost perfectly to how Databricks shows up in the real world. You can move fast and iterate in notebooks, but the same Lakehouse naturally nudg...
- 1 kudos
- 329 Views
- 3 replies
- 19 kudos
Training That Scales: How Databricks Adoption Really Takes Hold
I teach Databricks to all sorts of folks, coders, managers—everyone. What’s wild is how two companies with the same setup can have totally different experiences. Usually, it’s not the tech itself that’s the issue, but how people see it. Databricks tr...
- 329 Views
- 3 replies
- 19 kudos
- 19 kudos
As someone who benefited from Louis Training, I can attest that it makes a difference to constantly keep up to date and work on the foundation of understanding.Especially when things move so fast as in our industry, the time to reflect and improve pa...
- 19 kudos
- 5721 Views
- 8 replies
- 7 kudos
Cross-filtering for AI/BI dashboards
AI/BI dashboards now support cross-filtering, which allows you to click on an element in one chart to filter and update related data in other charts.Cross-filtering allows users to interactively explore relationships and patterns across multiple visu...
- 5721 Views
- 8 replies
- 7 kudos
- 7 kudos
There does appear to now be a list of capsules indicating the filters applied along the top of Databricks AI/BI Dashboards. The capsules appear to include filter-selectors and also cross-filters added by clicking charts.Also, there is a now "Reset t...
- 7 kudos
- 164 Views
- 1 replies
- 3 kudos
Unity Catalog Lineage: Lineage That Just Works
I've been working with Unity Catalog's lineage capabilities for a while now, and I have to say—this is what lineage should have always been. Not a separate tool to configure. Not a manual process to maintain. Just automatic, real-time visibility into...
- 164 Views
- 1 replies
- 3 kudos
- 3 kudos
I have been using and implementing UC in various workspaces across industry, BYOL is the one I am really looking forward to implement next.Thanks @AbhaySingh for consolidating it here.
- 3 kudos
- 180 Views
- 1 replies
- 1 kudos
Building an AgenticLakehouse: Interacting with Databricks Workspace via LangGraph and MCP
This project, AgenticLakehouse, explores the cutting edge of "Agentic Data Analytics." I didn't just want a chatbot; I wanted a "living" interface for the Lakehouse. The result is a Multi-Agent System that intelligently orchestrates tasks, from query...
- 180 Views
- 1 replies
- 1 kudos
- 1 kudos
Looks great, solid LangGraph + MCP setup on Databricks Apps. Thanks for sharing, @vinaygazula!
- 1 kudos
- 439 Views
- 0 replies
- 3 kudos
Semantic Bridge to Unity Catalog
How Ontos bridges the gap between technical metadata and business meaning Here's a scenario that might sound familiar. You've got Unity Catalog humming along—tables are registered, lineage is tracked, access controls are in place. Technically, every...
- 439 Views
- 0 replies
- 3 kudos
- 342 Views
- 4 replies
- 5 kudos
Spark Jobs View on a serverless cluster!! Naah.....
Have you ever noticed (and wondered) that the wonderful Spark Job UI is no longer available in the databricks notebook if the cell is executed using 'serverless' cluster?Tradionally, whenever we run the spark code (action command), we used to see the...
- 342 Views
- 4 replies
- 5 kudos
- 5 kudos
Hi RamanThank you for the amazing insights! I am trying to understand more about SQL Warehouses - is it managed by Unity Catalog? From what I could gather, SQL Warehouse is a compute layer, not a data layer and therefore not managed by Unity Catalog....
- 5 kudos
- 110 Views
- 0 replies
- 0 kudos
Fast-Track Your Databricks Development: Using Widgets for Test and Production Modes
Test Mode Pattern with Databricks Widgets - Demo What's IncludedThis package contains comprehensive documentation and examples for implementing the Test Mode Pattern in Databricks notebooks using widgets. This pattern enables fast development cycles ...
- 110 Views
- 0 replies
- 0 kudos
- 173 Views
- 0 replies
- 1 kudos
Your Coworkers Don't Get Databricks? Here's How to Fix That.
We've all been there. You're excited about the lakehouse, you see the value clear as day, and then you try explaining it to a coworker and their eyes glaze over. Slides don't cut it. Documentation links get ignored. What actually works? Showing them...
- 173 Views
- 0 replies
- 1 kudos
- 571 Views
- 4 replies
- 6 kudos
The Medallion Architecture: Why Data Layers Matter for Modern Organisations
In today’s data-driven world, organisations are drowning in information. From customer transactions and IoT sensor readings to social media interactions and operational logs, the volume and variety of data continue to grow exponentially. Yet many org...
- 571 Views
- 4 replies
- 6 kudos
- 6 kudos
Thank you, @Louis_Frolio ! My next post is about Data Governance with Unity Catalog, stay tuned!!
- 6 kudos
- 4827 Views
- 5 replies
- 0 kudos
Unity cataog
Disaster recovery is possible in Unity catalog now?Means, for data level, we have enabled with geo redundancy, what about the objects, permissions, an other components in Unity catalog ? Can we restore the unity catalog metadata in another region ?
- 4827 Views
- 5 replies
- 0 kudos
- 0 kudos
Official product release in development will be available as PrPr in a few months.
- 0 kudos
- 155 Views
- 0 replies
- 1 kudos
Managing Databricks CLI Versions in Your DAB Projects
If you are going with DABS into a production environment, a CLI version is considered best practice. Of course, you need to remember to bump it up from time to time. Learn more: - https://databrickster.medium.com/managing-databricks-cli-versions-i...
- 155 Views
- 0 replies
- 1 kudos
- 155 Views
- 0 replies
- 1 kudos
Distributed ML on Databricks Serverless
You can now run distributed ML (Spark MLlib in Python, Optuna tuning, MLflow Spark, Joblib Spark) on serverless notebooks/jobs and on standard clusters, not just dedicated ML clusters.It reuses the same Unity Catalog + Lakeguard stack you already use...
- 155 Views
- 0 replies
- 1 kudos
- 354 Views
- 0 replies
- 1 kudos
Why Your Delta Lake MERGE Takes Forever (And How to Fix It)
Last month, our nightly CDC pipeline started timing out. What used to complete in 20 minutes was now crawling past the 4-hour mark—and failing. The culprit? A MERGE statement against a 2.3TB Delta table with 800 million rows that had grown steadily o...
- 354 Views
- 0 replies
- 1 kudos
- 342 Views
- 0 replies
- 1 kudos
A Governance-First Unified Namespace:Why Manufacturers Need Unity Catalog to Scale Industry 4.0 Data
The Industrial Data ChallengeManufacturing enterprises today operate with a fundamental paradox: they're drowning in data yet starving for insights. A typical plant generates terabytes of information daily across dozens of systems—from shop floor PLC...
- 342 Views
- 0 replies
- 1 kudos
