Explore in-depth articles, tutorials, and insights on data analytics and machine learning in the Databricks Technical Blog. Stay updated on industry trends, best practices, and advanced techniques.
A single knowledge resource bridging platform limits, real PoC lessons, and automated ways of refactoring workflows
Databricks Serverless drives operational efficiency and slashes maintenance costs by...
You created a materialized view. You assumed it refreshed incrementally. Then, at 6 a.m., a refresh on a billion-row source ran a full recompute, and your monthly Databricks bill grew a leg.
This is t...
You likely maintain at least two separate copies of your crucial data. One resides in your data lake, serving as the source for pipeline writes, ML model training, and engineer debugging. The other is...
R1 is a leading provider of revenue management solutions for healthcare organizations, supporting hospitals, health systems, and physician groups across front-, middle-, and back-office revenue operat...
Your preferred AI model is a deeply personal choice. Public benchmarks might declare the “best” model for a specific task, but they don’t account for your workflow or how you access information, which...
This post is the second part of a two-part series on optimizing Databricks AI/BI dashboard performance at scale.
In the previous post, we focused how layout, filters, parameters, and caching determin...
Dashboard performance issues rarely come from a single place. They’re usually the combined effect of dashboard design, warehouse concurrency and caching and data layout in your lakehouse. If you optim...
It’s Monday Morning. Something’s Wrong.
It’s 7:15 AM. The VP of Manufacturing at a global pharmaceutical company opens her operations dashboard before her leadership meeting. Five manufacturing sites....
You've spent months planning the migration, the pipelines are built, and data is flowing into the new platform. Then comes the hard part: proving the data actually matches.
Business validation and re...
Unified governance and interoperability for unstructured data
Summary
Access unstructured data in Unity Catalog Volumes from any external tool or application using a new credential vending API that is...