Get Started Resources
Explore essential resources to kickstart your journey with Databricks. Access tutorials, guides, and...
0 Posts
Activity in Resources
- 32 Views
- 0 replies
- 0 kudos
I Built an AI-Powered Data Pipeline Generator for Databricks — Here Is What Happened
Building robust Medallion architectures takes time. Writing the same boilerplate for Auto Loader, streaming tables, and SCD Type 2 merges across different projects is a bottleneck.So, I ran an experiment: What happens if you let AI write your Spark D...
- 32 Views
- 0 replies
- 0 kudos
- 47 Views
- 0 replies
- 0 kudos
The Missing Correlation Layer in Databricks ModelOps | Building an AI Health Control Plane for DBx
SummaryThis post walks through the architecture of The Third Eye, a continuous AI health and governed ModelOps control plane built entirely on native Databricks capabilities. The core constraint: it never recomputes a metric Databricks already comput...
- 47 Views
- 0 replies
- 0 kudos
- 80 Views
- 0 replies
- 0 kudos
Task Success is not Routing Health: a Databricks Smart Routing Case Study
I ran the same 24 coding tasks through three arms: fixed Haiku, fixed Opus and Databricks-managed selection. The managed-selection arm passed all 24 tasks. Its 24 routing records also said task profiling was unavailable.That is not a contradiction. T...
- 80 Views
- 0 replies
- 0 kudos
- 554 Views
- 2 replies
- 2 kudos
Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics
Introduction Traditionally, unifying requires building brittle custom integrations for every single source. Lakeflow Connect resolves this with native, fully managed connectors for a full suite of martech sources, including ad connectors like Google ...
- 554 Views
- 2 replies
- 2 kudos
- 236 Views
- 1 replies
- 3 kudos
Announcing Databricks AppQuest: Hands-On Guidance and Cash Prizes for APJ Developers
SINGAPORE, [DATE] 2026, Databricks and AngelHack today announced Databricks AppQuest, a five-quest learning program that helps developers across Asia Pacific and Japan (APAC) build and ship working AI applications faster - taking them from an idea to...
- 236 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
Since 2011, AngelHack has been a global leader in developer relations and marketing, helping tech companies connect with a worldwide developer community.
- 3 kudos
- 691 Views
- 1 replies
- 1 kudos
Meet SDP Rewind: An undo button for your ETL pipelines
It's Saturday morning, and your phone goes off. A deployment that shipped Friday afternoon has been quietly writing bad data into your pipeline ever since, and now downstream dashboards are wrong. So you spend your weekend figuring out how far back t...
- 691 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
This is awesome, thank you for the walkthrough (especially the watermark example)!Since Rewind is scoped to one pipeline, could you clarify the recovery sequence for a separate downstream pipeline that has already consumed the affected rows through D...
- 1 kudos
- 890 Views
- 9 replies
- 27 kudos
Databricks Community Contest | Winners of the Genie-Powered App Challenge!
The Genie has spoken And the winners of the Genie-Powered App Challenge are… A few weeks ago, we threw down a challenge: build something incredible with Databricks Apps and Genie Agent. And wow, you delivered. From smart, real-world prob...
- 890 Views
- 9 replies
- 27 kudos
Latest Reply
- 27 kudos
Really happy to see ChicagoPulse win Gold in Track A!Thank you to the Databricks Community, the judges, and everyone who put the Genie Powered App Challenge together. I had a lot of fun building this and working on a real Chicago civic data use case....
- 27 kudos
- 1899 Views
- 3 replies
- 3 kudos
Identity Columns Best Practices for Databricks Lakehouse
The surrogate key problem nobody plans for Sooner or later every data warehouse needs surrogate keys. You are building a dimension table and you want a single narrow column your fact tables can join on instead of a wide composite of source attributes...
- 1899 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
In our architecture, in gold we are using materialized views for dimensions. How to generate surrogate key for them? as they don't support Identity columns
- 3 kudos
- 112 Views
- 0 replies
- 0 kudos
CUSTOMER STORY | Siemens Healthineers modernizes MRI scanner data on Databricks
“A straight move to the cloud would have cost two to four times more, so we would never have done it. The design with Databricks came out cheaper, and now we get the AI capabilities on top.” - Michae...
- 112 Views
- 0 replies
- 0 kudos
- 90 Views
- 0 replies
- 0 kudos
Announcement | Autoscaling Lakebase Postgres
Choosing a fixed database size before you know the workload is an old pattern. Lakebase Postgres removes that sizing exercise by continuously adjusting compute to match demand, while keeping PostgreSQL running and the data safely decoupled in the sto...
- 90 Views
- 0 replies
- 0 kudos
- 53 Views
- 0 replies
- 0 kudos
Building for Failure: Implementing Data Quality Firewalls in Petabyte-Scale Medallion Architectures
In my 13 years of architecting data platforms—from Retail to Industrial Gas Power—I’ve learned one universal truth: A fast pipeline that delivers bad data is just a liability.As we move toward Declarative Pipelines (DLT), the role of the Architect sh...
- 53 Views
- 0 replies
- 0 kudos
- 2552 Views
- 3 replies
- 4 kudos
What Does “Full Stack Development” Mean in the World of Databricks
Hi All, Many teams using Databricks today are referring to their work as “full stack development,” which can be a bit confusing at first. In the Databricks context, this doesn't mean a new framework — it simply means handling everything from raw data...
- 2552 Views
- 3 replies
- 4 kudos
Latest Reply
- 4 kudos
This is an interesting explanation of how Full Stack Development connects with the Databricks ecosystem. It’s important for developers to understand that modern full-stack roles can extend beyond traditional front-end and back-end development into d...
- 4 kudos
- 91 Views
- 0 replies
- 0 kudos
Where Omnigent Fits Alongside ChatGPT Work, Claude Cowork and Cursor Projects
If you use ChatGPT Work, Claude Cowork or Cursor Projects, much of Omnigent will look familiar.All of these products now organize work around projects, files and persistent context. They can run tasks for longer periods, connect to external tools and...
- 91 Views
- 0 replies
- 0 kudos
- 162 Views
- 1 replies
- 1 kudos
Materialized Views vs Streaming Tables in Databricks: A Practical Guide for Data Engineers
As data platforms move toward more declarative and incremental processing, one question comes up frequently when building pipelines in Databricks:Should I use a Materialized View or a Streaming Table?Both are important building blocks in Lakeflow pip...
- 162 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Most informative one @Islam_hoti
- 1 kudos
- 213 Views
- 2 replies
- 2 kudos
Lakebase Postgres branch stuck "disabled" after auto-archive → unarchive (Public Preview)
Hi all,Running into what looks like a platform bug with Lakebase Postgres (Public Preview) and hoping a community engineer can help, since my Databricks support case (#01009170) was closed as out of entitlement (personal account, no support contract)...
- 213 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
I also faced the same error as @jeremiasInetum. So I applied the steps from @Gokul_Pillai1 and status.disabled became false. After that, I navigate to branches in Lakebase. In branch overview, click on Protect button under Disable archiving.Click Se...
- 2 kudos
| User | Count |
|---|---|
| 1336 | |
| 687 | |
| 260 | |
| 184 | |
| 170 |
