Databricks Community

Data + AI Summit 2026: Registration Now Open - Early Bird Pricing!

June 15–18, 2026 Register Now! Join thousands of data analytics and AI professionals at Data+ AI Summit 2026, the world’s largest conference for data, analytics and AI in San Francisco and virtually. Don’t miss early-bird pricing! Early-bird discoun...

Agent Bricks | A Pilot to Production Series 🚀

95% of AI agents fail production – Agent Bricks fixes Accuracy, Flexibility & Security gaps with auto-tuning benchmarks, secure data connections, and built-in governance. The Proof is in Production:Banks save 200K hours/$250M, energy cuts outages 25%...

Notebook tags

Now you can also tag notebooks. Especially useful if you process any PII data. #databricks More news on https://databrickster.medium.com/

Change Data Feed - ingestion test

AUTO CDC made me curious about one practical question: if Auto CDC is now one of the easiest ways to process CDF, is it also the cheapest? To answer that, I compared 3 approaches: - AUTO CDC pipeline (in standard and performance mode)- Spark Structur...

🌟 Community Pulse: Your Weekly Roundup! March 30 – April 05, 2026

The Weekly Digest • March 30 – April 05 Community Pulse Fresh insights, top contributors, and technical deep-dives – curated for you.   Spotlight Contributors   Shoutout to the voices driving the most impactful conversations: @edonaire @Sumit_7...

Databricks Breaking News: 2026 Week 14: 30 March 2026 to 5 April 2026

Lakeflow Spark Declarative Pipelines now decouples pipeline and tables lifecycle

Ever deleted a pipeline… and accidentally wiped out the data with it? Databricks just introduced a beta feature that lets you decouple pipelines from the tables they manage.Lakeflow Spark Declarative Pipelines were desinged with data-as-code approach...

From 19 Hours to 80 Milliseconds: A Geospatial Cheesecake

I think the base is the best bit of a cheesecake, always have and always will, and when I started looking at geospatial data in Databricks, I was eating a cheesecake.  Government agencies dealing with geospatial data are stuck in a perfect storm of l...

Streaming syslog-ng data to your lakehouse: Powered by Zerobus Ingest OTEL

If you work in infrastructure or data engineering, there is a good chance syslog-ng is already somewhere in your stack. It is one of the most widely deployed open source log management tools in the world — battle-tested across Linux servers, network ...

CUSTOMER STORY | MakeMyTrip Achieved Millisecond Personalization at Scale with Databricks RTM

"We wanted one source of truth -- one Spark-based pipeline -- rather than two engines to maintain. Real-Time Mode gave us the performance we needed with the simplicity we wanted."   – Aditya Kumar, Associate Director of Engineering, MakeMyTrip MakeMy...

Workflows Parameterization: Build Flexible, Production-Ready Pipelines on Databricks

Author: @shwetav1407  Tags: #workflows, #orchestration, #jobs Welcome to the blog series exploring Databricks Workflows, a powerful product for orchestrating data processing, machine learning, and analytics pipelines on the Databricks Data Intellige...

Dashboards - ask Genie

We can ask Genie to explain the chart or its changes, such as spikes. There is a new button directly in the chart corner to start a conversation. more news https://databrickster.medium.com/

Why Custom URLs in Azure Databricks Are a Game-Changer for Enterprise Teams

If you’ve worked with Azure Databricks for a while, you’ve probably noticed one small but persistent friction point: the URLs.They’re long, system-generated, and not exactly memorable.Something like:Now imagine sharing that with business users, analy...

Community [Industry Talk #3] PubSec BrickTalk: Scaling Video Intelligence Using AI on Databricks

Databricks Metric Views

What is a Metric View? (Think of it as a virtual report definition)Metric Views are a first-class object in Databricks Unity Catalog that allow you to define reusable, governed business metrics on top of your existing tables and views.Think of them a...