Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
Data Engineering 1.0 was largely about integrating, moving, consolidating massive data to support enterprise decisions. Enterprises built ETL pipelines, data warehouses, data lakes and orchestration platforms to bring data together reliably. Data Eng...
Databricks Training & Certifications
Learn Databricks Lakehouse ️
One open platform for all your data, analytics, and AI.
One open platform Warehouse + Lake 易 Data + AI
Want one platform for all your data, analyti...
Paper event slips trace 18 Lakeflow AUTO CDC configurations: 13 stay on the main sequence while five branch into production stop signs. Change data capture (CDC) keeps a downstream table in step with row-level inserts, updates, and deletes instead of...
IntroductionMost architecture work starts with a request and a blank canvas. That is fine for early brainstorming, but it becomes risky when a proposed design ignores existing data products, ownership boundaries, workload constraints, cost signals, o...
When Fresh Research Becomes Enterprise IntelligenceMost research systems can collect papers. The useful ones can explain what a paper actually claims, what evidence supports it, and where the evidence stops. That is the job of this Research Discovery...
Crick Genie XI Track: Creative Thinking Project story Crick Genie XI started with a simple idea: what if a Crick scout could explore IPL history as naturally as they would talk to another analyst? The first version of the app was much more structured...
1. The problem and the opportunityRetailers run hundreds of trade promotions every month across many stores and SKUs. Discounts, buy one get one offers, and bundle deals are expensive levers, and most teams still evaluate them in silos. A category ma...
The problem: History that nobody can queryInsurance systems are hoarders. Every coverage change, deductible change, vehicle swap, address move and status flip on a policy is preserved, usually as SCD Type 2 history — years of it. And almost nobody us...
I built ChicagoPulse for the Databricks Community Genie-Powered App Challenge.Track: Track A - Real-World Problem SolverWhy it fits: ChicagoPulse solves a practical civic-data problem by helping residents, analysts, and decision-makers move from a na...
Repossession is the worst outcome in auto-finance servicing for everyone involved. The customer loses the car, the servicer loses money, and a surprising share of repossessions are avoidable, sometimes for a reason as small as a text that never arriv...
吏 What if learning SQL felt like a game?SQL is one of the most valuable skills in data and AI, but most people still learn it from static tutorials or documentation. Chatbots can answer questions, but they rarely push learners to think through a prob...
ProblemInsurance teams – SIU, retention, catastrophe risk, and distribution – need consistent answers from the same portfolio data, but conflicting metric definitions and ad-hoc SQL slow decisions.Built forAnalysts and managers in fraud investigation...
The ProblemSleep trackers collect a lot of information, including heart rate, movement, sleep stages, and wake events. But having more data does not always mean people understand their sleep better. A user might see a Sleep Quality Score of 72.7 and ...
Hi, I’m Ángel. I build data systems, break them more often than I would like to admit, and write about what I learn at Angelic Articles (my new own website for articles, previously on Medium).What I enjoy most is usually not getting the answer. It is...
Challenge Track: Track A — Real-World Problem SolverBuilt on: Databricks Free EditionLarge enterprises rarely have a reporting problem because they lack reports. More often, they have too many — but the critical problem is determining which reports a...