IntroductionAnatomy of a Delta Lake TableTime Travel and Auditing - HistoryTracking Incremental Changes - Change Data Feed (CDF)Optimising Storage - VACUUMWhat VACUUM DoesUndoing Mistakes - RESTOREMan...
Databricks Spark Declarative Pipelines (SDP) makes handling SCD easy with its Auto CDC feature. I had a customer who had to explode out an array as part of their pipeline in their streaming table and ...
The Challenge Enterprises often have hundreds or even thousands of legacy SQL queries or stored procedures written in platforms like SQL Server, Teradata, or Snowflake.Migrating these to Databricks m...
Introduction One of the biggest challenges with LLMs is bridging the gap between static knowledge and real-world actions. MCP solves this by providing a standard way for models to connect with exte...
Choosing the Best Model for Your Agent Oct 29, 2025 • Daniel Liden Introduction When you’re building an agent that needs to query your data and make decisions, comparing models across providers o...
The Challenge: Scaling ML for Personalized E-commerce Shutterfly, a leader in online photo printing and personalized e-commerce, faced significant scalability challenges with their machine learning in...
The Challenge: Cross-Cloud Data Sharing is Expensive Sharing data across cloud providers or even across regions in the same provider, egress fees can be quite high - in many cases orders of magnitude ...
One of the most common use cases in any long-running business is the ability to create a searchable catalog of a company’s collective body of knowledge. Much of that knowledge base is wrapped up in fi...
Introduction Private repositories are a common way for organizations to manage Python libraries, both internally developed packages and approved third-party dependencies. They provide an additional la...
Managing the bias-variance trade-off at scale by John Karlsson, Kyra Wulffert, Maria Zervou Introduction When building machine learning models on datasets that are segmented by categorical groups, ...
