Driving seamless access to data on social determinants of health is important for helping healthcare professionals better understand health inequities across social groups. The Social Determinants of Health Solution Accelerator shows how healthcare d...
The problem: technically correct, but still inconsistentMost analytics teams eventually encounter the same frustrating pattern: one dashboard reports revenue at 10.2M, another at 10.6M, and a spreadsheet says 10.4M. Each result may be technically def...
Databricks swapped the old partner labels this year; Registered / Select / Elite / Global Elite are gone, replaced by Bronze, Silver, Gold, and Platinum. Most write-ups on this are aimed at buyers choosing a vendor. I wanted to flip it for the people...
@ericka-lorenz , thanks for this helpful practitioner-oriented summary, I feel it important to add a couple of small footnotes. Based on the public Databricks partner-program pages, certifications clearly matter, though partner tiering seems to run o...
Lakebridge can assess an Alteryx estate, but the current support matrix does not list Alteryx for automated conversion or direct reconciliation. A safe migration therefore combines Lakebridge assessment with deliberate redesign, native Databricks eng...
Hi everyone,I’m leading an implementation where we’re comparing events from two real-time streams — a Source and a Target — in Databricks Structured Streaming (Scala).Our goal is to identify and emit “delta” differences between corresponding records ...
The overall pattern is sound, but there are a few real production risks worth calling out. Delta point reads inside the state function are your biggest bottleneck. When flatMapGroupsWithState (or its replacement transformWithState) fetches a JSON fro...
Performance optimization in Databricks used to follow a familiar playbook:Partition large Delta tables.Compact small files with OPTIMIZE.apply ZORDER BY on frequently filtered columns.Run VACUUM.Collect statistics.Increase cluster size when queries r...
Dear Databricks Community,One thing I have learned from my data engineering experience is that big solutions do not always start big.Many times, they start with one simple question.Can we make this easier?Can we make this faster?Can we help someone m...
Hi community!Matei Zaharia and the Databricks team just announced the release of Apache Spark 4.2. As a Data Architect, seeing how this engine is evolving to bridge the gap between traditional data engineering, governance, and the AI era is incredibl...
Medallion Architecture in Practice: The Design Decisions Nobody Puts in the DiagramEvery Lakehouse conversation eventually shows the same three boxes: Bronze, Silver, Gold. It's a great mental model — but on a real enterprise migration, the diagram i...
Great work, man! Even though I don't know much about this field, your article made me curious and motivated me to read more about it. Thanks for sharing such valuable insights.keep posting
Why We Used Delta Live Tables for Exactly One Pipeline (and Not for Silver/Gold)"Why isn't DLT used everywhere?" is one of the first questions I get when reviewing this architecture with other engineers — so I figured it was worth writing up properly...
I must admit, this was a nagging question I never asked as a junior data engineer and have just taken for granted every since. Thanks for addressing an oversight I didnt even know I had!
How We Cut Refresh Time and Compute Cost by ~60% — the Mechanics, Not Just the Headline"We reduced compute costs by 60%" is a great line in a slide deck and a mostly useless one in a technical forum, because it doesn't tell you why. Here's the actual...
In enterprise environments, the bottleneck of Machine Learning is rarely the algorithms themselves—it is the engineering around them. Data scientists often spend days configuring environments, managing infrastructure, and manually tracking model iter...
Recently I earned the Databricks Machine Learning Professional certification and wanted to share my study journey. Before the exam, I worked on a project as a data engineer alongside data scientists (ML models, LLMs, MLflow). That led me to build a p...
Congratulations on earning the Databricks Machine Learning Professional certification! Your RAG project breakdown is genuinely helpful because it connects the concepts with real hands-on practice. Along with the official guide and labs, I also found ...
This is part 1 of 3 in a series where I take you through working with Metric Views.Part 1: Introduction to Metric ViewsPart 2: Metric Views and the Databricks platform (AI/BI Dashboards, Genie, etc.)Part 3: Metric Views with Power BI and Tabular Edit...
Great introduction! A centralized semantic layer with Metric Views should make metrics more consistent and easier to govern across Databricks. Looking forward to seeing the real-world integrations in Part 2.
I just earned my Databricks Certified Generative AI Engineer Associate Certification, and in this post, I’m sharing the key tips, resources, and including what confused me, what actually worked, and the traps I nearly fell into. Why I Took This ExamI...
Thanks for sharing,do you know what is the passing score to clear the exam?
| User | Count |
|---|---|
| 85 | |
| 75 | |
| 72 | |
| 60 | |
| 43 |
