A few months back my team at Genpact picked up a real world evidence project for a life sciences client that had been running on Kedro for a couple of years. The pipeline touched patient level claims and EHR extracts, ran feature engineering for a ha...
AI is becoming part of almost every data engineering workflow.We are asking AI to generate SQL, PySpark pipelines, data-quality rules, unit tests, technical specifications and even complete project structures. The results can be impressive, but there...
Yes that's true. There are hundreds (if not 100s) of tasks that can be done without depending on the agents. Databricks indeed has DQX for governance and data quality. Instead of relying on smaller activities (especially when they are repeating in na...
The problem: rethinking routing in multi-agent systems on DatabricksDatabricks native supervisor agent pattern is a solid default for orchestrating multiple Genie spaces and tools but it comes with a routing constraint worth examining. The superviso...
A rising AI bill can have several explanations. More work is being completed. Documents are getting longer. Failed requests are being repeated. Or a model chosen during a proof of concept has become the default for every task.Each explanation calls f...
Built for the Databricks Community Genie-Powered App Challenge 2026 — Track A: Real-World Problem Solver THE PROBLEM THAT DOESN'T SHOW UP ON A DASHBOARD Most small businesses don't fail because they run out of customers. They fail because they discov...
Data Engineering 1.0 was largely about integrating, moving, consolidating massive data to support enterprise decisions. Enterprises built ETL pipelines, data warehouses, data lakes and orchestration platforms to bring data together reliably. Data Eng...
Databricks Training & Certifications Learn Databricks Lakehouse ️ One open platform for all your data, analytics, and AI. One open platform Warehouse + Lake 易 Data + AI Want one platform for all your data, analyti...
Paper event slips trace 18 Lakeflow AUTO CDC configurations: 13 stay on the main sequence while five branch into production stop signs. Change data capture (CDC) keeps a downstream table in step with row-level inserts, updates, and deletes instead of...
IntroductionMost architecture work starts with a request and a blank canvas. That is fine for early brainstorming, but it becomes risky when a proposed design ignores existing data products, ownership boundaries, workload constraints, cost signals, o...
When Fresh Research Becomes Enterprise IntelligenceMost research systems can collect papers. The useful ones can explain what a paper actually claims, what evidence supports it, and where the evidence stops. That is the job of this Research Discovery...
Crick Genie XI Track: Creative Thinking Project story Crick Genie XI started with a simple idea: what if a Crick scout could explore IPL history as naturally as they would talk to another analyst? The first version of the app was much more structured...
Crick here is Cricket_. I was not allowed to write Cricket_ because of community guidelines so I changed it to Crick
1. The problem and the opportunityRetailers run hundreds of trade promotions every month across many stores and SKUs. Discounts, buy one get one offers, and bundle deals are expensive levers, and most teams still evaluate them in silos. A category ma...
Intersting!
The problem: History that nobody can queryInsurance systems are hoarders. Every coverage change, deductible change, vehicle swap, address move and status flip on a policy is preserved, usually as SCD Type 2 history — years of it. And almost nobody us...
I built ChicagoPulse for the Databricks Community Genie-Powered App Challenge.Track: Track A - Real-World Problem SolverWhy it fits: ChicagoPulse solves a practical civic-data problem by helping residents, analysts, and decision-makers move from a na...
Repossession is the worst outcome in auto-finance servicing for everyone involved. The customer loses the car, the servicer loses money, and a surprising share of repossessions are avoidable, sometimes for a reason as small as a text that never arriv...
| User | Count |
|---|---|
| 85 | |
| 76 | |
| 73 | |
| 60 | |
| 43 |
