cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Community Articles
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
naveenayalla
by • New Contributor III
  • 1494 Views
  • 1 replies
  • 2 kudos

Building an Incremental Customer Data Migration Workflow in Databricks

Building an Incremental Customer Data Migration Workflow in DatabricksBy Naveen AyallaIntroductionIn many enterprise environments, customer data is spread across legacy systems that were originally designed for operational processing rather than mode...

Community Articles
Reply
  • 1494 Views
  • 1 replies
  • 2 kudos
View Replies
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 2 kudos

Great write-up, Naveen. Very practical and clear.I really like how you focused not just on migration, but on building a reliable incremental workflow with proper duplicate handling and governance. That’s where real value comes from.Also, connecting D...

  • 2 kudos
bergun
by • New Contributor II
  • 576 Views
  • 0 replies
  • 1 kudos

Operating PostgreSQL CDC on AWS RDS with Lakeflow Connect

Over the years, I have helped organizations design and deliver large-scale data platforms, and one recurring lesson has remained constant: CDC failures are rarely caused by technology alone. They are usually the result of unclear ownership, missing o...

Community Articles
Reply
  • 576 Views
  • 0 replies
  • 1 kudos
akiya
by • New Contributor II
  • 339 Views
  • 0 replies
  • 1 kudos

DAIS Community Virtual Challenge 2026: Sysl — Scanning Japanese Receipts

The ProblemLiving in Japan means getting handed receipts everywhere — convenience stores, pharmacies, restaurants. Most end up in a pocket or trash, never tracked, and the coupons go unused.The SolutionSysl is a PWA that scans any Japanese receipt au...

akiya_0-1780637427278.png akiya_2-1780637603728.png akiya_3-1780637677363.png
Community Articles
Reply
  • 339 Views
  • 0 replies
  • 1 kudos
ashish51
by • New Contributor III
  • 886 Views
  • 1 replies
  • 2 kudos

DAIS Community Virtual Challenge 2026: LEGO Value Engine - using Data and AI to Find the Best LEGO

Hey everyone!For the DAIS 2026 Community Virtual Challenge, I built a LEGO Value Engine using Databricks Free Edition.This is a passion project that combined my interests of both LEGOs and Data Engineering.When a new LEGO set releases, it can be hard...

Community Articles
Reply
  • 886 Views
  • 1 replies
  • 2 kudos
View Replies
Latest Reply
ashish51
New Contributor III
  • 2 kudos

GitHub Repository: Lego Value Engine Architecture Diagram (better quality version can be found here) 

  • 2 kudos
tanampas_
by • New Contributor II
  • 865 Views
  • 0 replies
  • 3 kudos

# Retail demand forecasting on Databricks Free Edition

Hi Databricks Community,I built a retail sales forecasting system on Databricks Free Edition using the Rossmann Store Sales dataset — about 1,115 stores with daily sales over two and a half years. The goal was a 48-day forecast, the same horizon as t...

tanampas__0-1780621188188.png tanampas__1-1780621209109.png tanampas__2-1780621255640.png
Community Articles
Reply
  • 865 Views
  • 0 replies
  • 3 kudos
aman_k_sharma1
by • New Contributor III
  • 600 Views
  • 0 replies
  • 2 kudos

Building a Scalable Data Pipeline with Databricks Free edition | Spark Declarative Pipelines

I recently built an end-to-end data pipeline architecture in the transportation domain, focusing on city and trip data. The pipeline follows the Bronze–Silver–Gold layered approach, where raw data is ingested into the Bronze layer, cleaned and standa...

Community Articles
Reply
  • 600 Views
  • 0 replies
  • 2 kudos
Avinash_Narala
by • Databricks Partner
  • 289 Views
  • 0 replies
  • 0 kudos

Solving the "Untitled" Lineage Mystery in Unity Catalog

Hey everyone,Have you ever opened Databricks Catalog Explorer to audit a table, only to find the downstream job listed as "Untitled"? Databricks Unity Catalog is incredibly powerful for automated lineage, but it quietly breaks the moment you orchestr...

Community Articles
Reply
  • 289 Views
  • 0 replies
  • 0 kudos
ramprakash_bala
by • New Contributor III
  • 1997 Views
  • 2 replies
  • 4 kudos

How I Passed the Databricks GenAI Engineer Associate — A No-Fluff Study Guide

Hello Everyone, As a Data & Analytics Engineer with experience spanning ETL, data engineering, solution design, and data platform engineering, I currently work Azure Data Ecosystem involving Azure Databricks, Terraform, and CI/CD pipelines — building...

ramprakash_bala_0-1780066014008.png
Community Articles
Reply
  • 1997 Views
  • 2 replies
  • 4 kudos
View Replies
Latest Reply
OscarJ
New Contributor II
  • 4 kudos

Really helpful blog, thanks Ramprakash!

  • 4 kudos
1 More Replies
ShamenParis
by • Contributor III
  • 876 Views
  • 0 replies
  • 0 kudos

Stop giving your Databricks AI Agents 50 tools to manage

If you are building enterprise Generative AI, you know the pain of the "Monolithic Agent Bottleneck": passing dozens of tools to a single AI supervisor leads to hallucinated routing, massive context bloat, and security nightmares.With the recent May ...

Community Articles
Reply
  • 876 Views
  • 0 replies
  • 0 kudos
Labels