Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
How We Cut Refresh Time and Compute Cost by ~60% — the Mechanics, Not Just the Headline"We reduced compute costs by 60%" is a great line in a slide deck and a mostly useless one in a technical forum, because it doesn't tell you why. Here's the actual...
In enterprise environments, the bottleneck of Machine Learning is rarely the algorithms themselves—it is the engineering around them. Data scientists often spend days configuring environments, managing infrastructure, and manually tracking model iter...
This is part 1 of 3 in a series where I take you through working with Metric Views.Part 1: Introduction to Metric ViewsPart 2: Metric Views and the Databricks platform (AI/BI Dashboards, Genie, etc.)Part 3: Metric Views with Power BI and Tabular Edit...
Great introduction! A centralized semantic layer with Metric Views should make metrics more consistent and easier to govern across Databricks. Looking forward to seeing the real-world integrations in Part 2.
I just earned my Databricks Certified Generative AI Engineer Associate Certification, and in this post, I’m sharing the key tips, resources, and including what confused me, what actually worked, and the traps I nearly fell into. Why I Took This ExamI...
Databricks Academy offers the free Machine Learning at Scale course to help machine learning practitioners understand how Apache Spark supports ML workloads on Databricks. As the first course in the Advanced Machine Learning series, it focuses on pra...
Product recommendations help guide customers through their shopping journey. The Building Common Sense Product Recommendations With LLMs Solution Accelerator shows how retailers can use LLMs to develop recommendations for new-to-market products by tu...
Every few weeks, the same conversation plays out in mid-sized data teams. Someone hits a wall with the current warehouse, a demo of Databricks goes well, and suddenly the question on the table is "should we migrate?" The problem is that most teams ev...
Dear Databricks Community,I would like to share a few thoughts on how the role of data platforms may evolve in the agentic AI era. Inspired by Satya Nadella’s recent article on the “Reverse Information Paradox,” I started thinking about a deeper ques...
I came across this checklist for hiring a Databricks implementation partner, and it turned out to be the best in-house build checklist I've read in a while. 27 Questions to Choose a Databricks Implementation Partner looks like procurement filler at f...
I Built a Custom MCP Server on Databricks — Here’s What the Managed Version Can’t DoPart 2 of the MCP on Databricks seriesIn Part 1, I covered what Genie MCP and DBSQL MCP give you out of the box — and where they stop.The short version: both are stat...
Databricks Academy offers the free Automated Deployment with Declarative Automation Bundles course to help data engineers apply DevOps practices to Databricks projects. As the fourth course in the Advanced Data Engineering with Databricks series, it ...
AI-assisted coding is changing how data engineers build on Databricks.A developer can now generate Spark SQL, PySpark transformations, Delta table DDL, pipeline logic, data-quality checks, documentation, and test scenarios much faster than before. W...
Fraud detection becomes more effective when organizations can understand where and how customers normally spend. The Identify Fraud With Geospatial Analytics and AI Solution Accelerator shows how geospatial data, machine learning and a lakehouse arch...
Hi Databricks Community,I wrote an article sharing my thoughts on where data engineering is heading in the AI era.For a long time, data engineering has been about pipelines, transformations, validations, trusted layers, and dashboards. That foundatio...
Databricks Academy offers the free Databricks Performance Optimization course to help data engineers improve workload performance on the Databricks Data Intelligence Platform. As part of the Advanced Data Engineering with Databricks series, it focuse...