Explore in-depth articles, tutorials, and insights on data analytics and machine learning in the Databricks Technical Blog. Stay updated on industry trends, best practices, and advanced techniques.
Note: This blog post summarizes the Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub.
Tutorial: Databricks Genie for Data Engineers and Data Scientis...
Transferz, a fast-growing travel tech platform, eliminated its data team bottleneck by deploying AI/BI Genie — achieving 89,5% adoption across business users achieving 60% operational improvements.Th...
Organizations use AI/BI dashboard tables to review accounts, catch problems, and decide what to do next. Yet a plain table can hold all the right data and still be hard to read.
One way to improve the...
Introduction
Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of mar...
A bad deployment slips into your pipeline on Friday, and by Monday, it has been writing incorrect data for three days, with no clean way to roll it back. You can restore one table, but a pipeline is a...
The “why” worth knowing
Choosing external tables is usually about flexibility: you keep dedicated storage, maintain raw files that multiple engines can query directly, and control your own partitionin...
Summary
Explore how Real-Time Mode for Apache Spark Structured Streaming on Databricks now supports inner stream-stream joins in update mode with sub-second latency.See it in action on a real-time ad ...
Take a quick inventory of where your operational data lives right now. There is probably a Kafka cluster carrying your event backbone, or perhaps RabbitMQ capturing messages on a factory floor or bet...
A year ago we put a natural-language layer on a 3D map. This time we rebuilt the whole thing on Lakebase and PostGIS, wired Genie to the same tables, and made the map answer back, drawn region and all...
Many dashboards eventually answer the same questions:
Are we hitting our targets?Where are we falling short?
A dumbbell chart answers these questions at a glance.
For each category, it plots two valu...