Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
For years, enterprise data architecture has followed a familiar pattern.An application writes customer orders, account updates, inventory changes, or transactions into an operational database.Then data engineering takes over.We capture changes throug...
Overview
Prompted by a customer question, I wanted to see what was possible in terms of MCP integration into Genie Code, in order to try this out I decided to look at Azure Dev Ops, as it's a common workflow to want to see your tickets alongside the ...
Hi Emma how are you? is there any solution to make this agent avaliable for multiple users? the main restriction is that the path will be linked to a single user/service princpal.thanks!
A question came up in the community recently that I thought deserved more than a short answer. The question was around how to build a reliable investigation sequence for slow Spark jobs, specifically when symptoms overlap. A long-running stage with ...
Thanks for this! Very insightful and detailed. Your sequence for diagnosing slow Spark jobs when symptoms overlap is exactly what I needed. Bookmarked this for my team.
I just earned my Databricks Certified Generative AI Engineer Associate Certification, and in this post, I’m sharing the key tips, resources, and including what confused me, what actually worked, and the traps I nearly fell into. Why I Took This ExamI...
One Question Can Light the SparkMy Databricks journey started in 2022 with simple interest, curiosity, and a dream to learn more.At that time, I was just trying to understand the platform, follow the updates, learn from others, and slowly build my co...
If you've ever worked on an insurance data warehouse, or really any warehouse where data arrives from different systems at different times, you know the pain of keeping things in sync.
I spent years building data warehouses for a property and casual...
IntroductionApache Spark has become one of the most widely adopted engines for large-scale data processing. Its appeal is easy to understand: it supports batch processing, streaming workloads, feature engineering, machine learning pipelines, and lar...
I have spent the past couple of months building up a small hobby YouTube project where I run through Databricks Features in an easy to digest format.I am for a very hands-on and demo heavy approach so you can actually see what is going on, and how th...
The next video is ready!ImportBI is a new skill added to Genie that allows you to speed up migration from PowerBI and Tableau to Databricks. This time we look at a simple model - but stay tuned (... and subscribe!) for a deep dive on a larger model n...
How Databricks’ AI agent transforms data engineering from manual craftsmanship into conversational pipeline development
Data engineers have long accepted a painful truth: building production-grade ETL pipelines means wrestling with hundreds ...
Just back from Data and AI Summit 2026 and I am still buzzing.This was my best summit yet. Moscone was packed. More than 30,000 of us in one place, from over 150 countries, all there for the same reason. To build better with data and AI.The keynotes ...
@Brahmareddy Thank you so much for your support of the Community! It was such a delight to see you at the Community booth and meet up in person. I'm looking forward to working with you as a Community Champion and making this an even better place for ...
This is part 3 of 3 in a series where I take you through working with Metric Views.Part 1: Introduction to Metric ViewsPart 2: Metric Views and the Databricks platform (AI/BI Dashboards, Genie, etc.)Part 3: Metric Views with Power BI and Tabular Edit...
@nikhil-dbx as far as I understand that feature the idea is to provide a multi-fact pattern for Dashboards specifically for now.I am yet to get my hands on the preview for Dashboard Relationships as they are called. I will update with a new article ...
Databricks CustomerLake: Inside the Agentic CDP Built for the Age of AIA deep dive into what CustomerLake actually is, how it works, and what it looks like in practice.At Data + AI Summit 2026, Databricks announced CustomerLake — an Agentic Customer ...
With Genie Code, you can now add a Tableau or Power BI file and have it build an AI/BI dashboard that replicates your existing visualizations - while connecting them to metric views that mirror the underlying business logic.Import BI files using Geni...
How does databricks handle calculated fields etc In TWB files they are referenced as calculation_1234.... does databricks store these references at the data model level to resolve them when I upload a TWB file
Part 4 of my enterprise data platform series is up - this one cover why we added a fifth layer to the standard medallion architecture.We connected BI tools to the Gold layer and immediately hit four problems Gold alone couldn't solve:Schema breaks wh...
Hello Databricks Community!I recently published a detailed breakdown on Medium about a real-world optimization nightmare we faced, and I wanted to share the core lessons learned with this group.We had a highly efficient Delta table pipeline handling ...