- 247 Views
- 3 replies
- 19 kudos
Training That Scales: How Databricks Adoption Really Takes Hold
I teach Databricks to all sorts of folks, coders, managers—everyone. What’s wild is how two companies with the same setup can have totally different experiences. Usually, it’s not the tech itself that’s the issue, but how people see it. Databricks tr...
- 247 Views
- 3 replies
- 19 kudos
- 19 kudos
As someone who benefited from Louis Training, I can attest that it makes a difference to constantly keep up to date and work on the foundation of understanding.Especially when things move so fast as in our industry, the time to reflect and improve pa...
- 19 kudos
- 5681 Views
- 8 replies
- 7 kudos
Cross-filtering for AI/BI dashboards
AI/BI dashboards now support cross-filtering, which allows you to click on an element in one chart to filter and update related data in other charts.Cross-filtering allows users to interactively explore relationships and patterns across multiple visu...
- 5681 Views
- 8 replies
- 7 kudos
- 7 kudos
There does appear to now be a list of capsules indicating the filters applied along the top of Databricks AI/BI Dashboards. The capsules appear to include filter-selectors and also cross-filters added by clicking charts.Also, there is a now "Reset t...
- 7 kudos
- 103 Views
- 1 replies
- 2 kudos
Unity Catalog Lineage: Lineage That Just Works
I've been working with Unity Catalog's lineage capabilities for a while now, and I have to say—this is what lineage should have always been. Not a separate tool to configure. Not a manual process to maintain. Just automatic, real-time visibility into...
- 103 Views
- 1 replies
- 2 kudos
- 2 kudos
I have been using and implementing UC in various workspaces across industry, BYOL is the one I am really looking forward to implement next.Thanks @AbhaySingh for consolidating it here.
- 2 kudos
- 156 Views
- 1 replies
- 1 kudos
Building an AgenticLakehouse: Interacting with Databricks Workspace via LangGraph and MCP
This project, AgenticLakehouse, explores the cutting edge of "Agentic Data Analytics." I didn't just want a chatbot; I wanted a "living" interface for the Lakehouse. The result is a Multi-Agent System that intelligently orchestrates tasks, from query...
- 156 Views
- 1 replies
- 1 kudos
- 1 kudos
Looks great, solid LangGraph + MCP setup on Databricks Apps. Thanks for sharing, @vinaygazula!
- 1 kudos
- 384 Views
- 0 replies
- 3 kudos
Semantic Bridge to Unity Catalog
How Ontos bridges the gap between technical metadata and business meaning Here's a scenario that might sound familiar. You've got Unity Catalog humming along—tables are registered, lineage is tracked, access controls are in place. Technically, every...
- 384 Views
- 0 replies
- 3 kudos
- 322 Views
- 4 replies
- 5 kudos
Spark Jobs View on a serverless cluster!! Naah.....
Have you ever noticed (and wondered) that the wonderful Spark Job UI is no longer available in the databricks notebook if the cell is executed using 'serverless' cluster?Tradionally, whenever we run the spark code (action command), we used to see the...
- 322 Views
- 4 replies
- 5 kudos
- 5 kudos
Hi RamanThank you for the amazing insights! I am trying to understand more about SQL Warehouses - is it managed by Unity Catalog? From what I could gather, SQL Warehouse is a compute layer, not a data layer and therefore not managed by Unity Catalog....
- 5 kudos
- 105 Views
- 0 replies
- 0 kudos
Fast-Track Your Databricks Development: Using Widgets for Test and Production Modes
Test Mode Pattern with Databricks Widgets - Demo What's IncludedThis package contains comprehensive documentation and examples for implementing the Test Mode Pattern in Databricks notebooks using widgets. This pattern enables fast development cycles ...
- 105 Views
- 0 replies
- 0 kudos
- 161 Views
- 0 replies
- 1 kudos
Your Coworkers Don't Get Databricks? Here's How to Fix That.
We've all been there. You're excited about the lakehouse, you see the value clear as day, and then you try explaining it to a coworker and their eyes glaze over. Slides don't cut it. Documentation links get ignored. What actually works? Showing them...
- 161 Views
- 0 replies
- 1 kudos
- 507 Views
- 4 replies
- 6 kudos
The Medallion Architecture: Why Data Layers Matter for Modern Organisations
In today’s data-driven world, organisations are drowning in information. From customer transactions and IoT sensor readings to social media interactions and operational logs, the volume and variety of data continue to grow exponentially. Yet many org...
- 507 Views
- 4 replies
- 6 kudos
- 6 kudos
Thank you, @Louis_Frolio ! My next post is about Data Governance with Unity Catalog, stay tuned!!
- 6 kudos
- 4770 Views
- 5 replies
- 0 kudos
Unity cataog
Disaster recovery is possible in Unity catalog now?Means, for data level, we have enabled with geo redundancy, what about the objects, permissions, an other components in Unity catalog ? Can we restore the unity catalog metadata in another region ?
- 4770 Views
- 5 replies
- 0 kudos
- 0 kudos
Official product release in development will be available as PrPr in a few months.
- 0 kudos
- 149 Views
- 0 replies
- 1 kudos
Managing Databricks CLI Versions in Your DAB Projects
If you are going with DABS into a production environment, a CLI version is considered best practice. Of course, you need to remember to bump it up from time to time. Learn more: - https://databrickster.medium.com/managing-databricks-cli-versions-i...
- 149 Views
- 0 replies
- 1 kudos
- 145 Views
- 0 replies
- 1 kudos
Distributed ML on Databricks Serverless
You can now run distributed ML (Spark MLlib in Python, Optuna tuning, MLflow Spark, Joblib Spark) on serverless notebooks/jobs and on standard clusters, not just dedicated ML clusters.It reuses the same Unity Catalog + Lakeguard stack you already use...
- 145 Views
- 0 replies
- 1 kudos
- 310 Views
- 0 replies
- 1 kudos
Why Your Delta Lake MERGE Takes Forever (And How to Fix It)
Last month, our nightly CDC pipeline started timing out. What used to complete in 20 minutes was now crawling past the 4-hour mark—and failing. The culprit? A MERGE statement against a 2.3TB Delta table with 800 million rows that had grown steadily o...
- 310 Views
- 0 replies
- 1 kudos
- 316 Views
- 0 replies
- 1 kudos
A Governance-First Unified Namespace:Why Manufacturers Need Unity Catalog to Scale Industry 4.0 Data
The Industrial Data ChallengeManufacturing enterprises today operate with a fundamental paradox: they're drowning in data yet starving for insights. A typical plant generates terabytes of information daily across dozens of systems—from shop floor PLC...
- 316 Views
- 0 replies
- 1 kudos
- 730 Views
- 3 replies
- 4 kudos
Metric Views in Databricks: A Unified Approach to Business Metrics
Databricks has introduced a powerful feature—Metric Views—that transforms how organizations define, manage, and consume business metrics. Whether you're a data analyst, engineer, or business stakeholder, Metric Views offer a unified, governed, and re...
- 730 Views
- 3 replies
- 4 kudos
