Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
The question no dashboard answers“Why was production reduced yesterday?”— every plant head, every morningFour systems hold the answer and none of them are speaking. This is how we built a factory-floor intelligence app where every single insight — in...
In 1929 a Catholic theologian wrote ten rules for detective fiction. Ronald Knox was only half serious. He and Chesterton and Sayers had a dining club for writers of detective fiction and the rules were closer to a party game than a manifesto, but th...
A retail medallion pipeline packaged as a bundle, promoted through Dev, QA, and Production from a single repository — including the deployment-mode bug that made every stage go green while shipping a job that could never have run.Most Databricks proj...
@Isaac_18 wrote:For production, deploy to a shared location and run as a service principal.Doing this will give you a warning on the deployment as it will grant everyone read/write access to the underlying assets. Warning: the bundle root path /Works...
Promo Genie: Turning Trade-Promotion Data into Actionable DecisionsPromo Genie is a Databricks-native trade-promotion intelligence application built for Bisky Delight, a fictional FMCG biscuit brand. It combines governed Lakehouse data with a Genie A...
Executive Summary & Problem StatementBusiness Challenge: Global supply chains face frequent delays from unpredictable weather and geopolitical tensions. Operations teams struggle to extract fast, actionable insights from complex Delta Lake tables.Co...
Importing an existing Databricks Lakeflow Job into a Declarative Automation Bundle?The missing piece is the DAB state file to track workspace objects by ID! I wrote a practical walkthrough:• Capture the current definition• Generate and review the YAM...
Hi Databricks Community,I wanted to share a project I've been building over the past few months using Databricks on Azure , a production Lakehouse pipeline for retail pricing analytics.What it doesIngests ~21,000 products daily across 16 categories f...
Databricks architects… you might want to bookmark this one.Ever spent way too long hunting for the right Databricks icon while building an architecture diagram?I’ve been working on something to make that a lot easier. SVG + PNG for every product (Un...
Early Warning: giving a school principal Monday morning backBuilt for the Databricks Community Contest — Genie Powered App Challenge, Track AThe problemEvery Monday, a handful of people at a high school ask the same six questions. Which students cros...
Discussed the BI & Metrics Tax elimination using Databricks Metric Views here. Organizations also face an older more persistent tax — the Ingestion Tax.To ingest data from a source like Salesforce or SQL Server into your Lakehouse, you typically stit...
The point about “ingestion tax” is interesting because tooling sprawl can create hidden costs beyond the actual software licenses. Fragmented pipelines, maintenance work, and governance gaps can all add operational overhead as data environments grow....
Every sales manager I've ever talked to has the same quiet frustration: the CRM has all the answers, but getting to them takes forever. You want to know which deals are actually at risk this week, and instead you're pivoting spreadsheets, cross-refer...
Last week a teammate ran databricks bundle deploy against our dev workspace. It failed on a schema that already existed. She had not touched that schema. Nobody had. Her code was identical to mine, and my deploy had worked ten minutes earlier.The cau...
A pattern that shows up repeatedly when people move a working Structured Streaming pipeline from "runs fine in a workspace notebook" to "runs in CI via Databricks Connect against serverless" is a ModuleNotFoundError that only appears in the second co...
A pattern that shows up repeatedly when people move a working Structured Streaming pipeline from "runs fine in a workspace notebook" to "runs in CI via Databricks Connect against serverless" is a ModuleNotFoundError that only appears in the second co...
Aquí os dejo mi nuevo vídeo sobre Databricks para la comunidad de hablantes en español. Se recorre la arquitectura de datos de Databricks desde el Workspace hasta los archivos Parquet que almacenan físicamente la información.El objetivo no es simplem...