Today, we’re celebrating a very special milestone: the São Paulo Databricks User Group has reached 500 members.More than just a number, these are 500 professionals united by a shared passion for data, AI, analytics, data engineering, and innovation. ...
Hello Everyone, As a Data & Analytics Engineer with experience spanning ETL, data engineering, solution design, and data platform engineering, I currently work Azure Data Ecosystem involving Azure Databricks, Terraform, and CI/CD pipelines — building...
Hi Everyone,I just publsihed an detailed article in medium for migrating the stored procedures to pyspark #https://medium.com/p/909c5c700ffd?postPublishedType=initial
Part 1 of a 5-part series on building an enterprise data platform on Databricks.When migrating a large retail conglomerate's SAP HANA platform to Databricks, we needed both historicalcompleteness and near-real-time freshness from day one.That require...
Hey everyone!For the DAIS 2026 Community Virtual Challenge, I built a LEGO Value Engine using Databricks Free Edition.This is a passion project that combined my interests of both LEGOs and Data Engineering.When a new LEGO set releases, it can be hard...
Body:Every day, data platforms generate thousands of audit events. But here's the problem: security teams are drowning in noise.Critical risks hide in plain sight. Manual investigations take hours. Compliance gaps surface too late. And there's no int...
If you are building enterprise Generative AI, you know the pain of the "Monolithic Agent Bottleneck": passing dozens of tools to a single AI supervisor leads to hallucinated routing, massive context bloat, and security nightmares.With the recent May ...
Hi folks, So I have recently, as a side project been working on a tool, Link to my github: https://github.com/JeffDenzel/lineage-syncer.The problemThe reason for it is that DataBricks allows you to put external data assets into your UC. However, ther...
Hi Databricks Community,For the DAIS 2026 Community Virtual Contest, I built a project called Grocery Data Intelligence. This is a Smart Grocery Planning solution with Data + AI, built using Databricks Free Edition.The idea came from a very simple re...
Adding the full architecture here below. The goal is to keep the data flow simple, trusted, and reusable across dashboards, Ask Data + AI, inventory storytelling, and action recommendations.Raw Grocery Data: Stores, Products, Sales, Inventory↓Bronze ...
I'm exploring an idea that combines event discovery, weather intelligence, and safety awareness into a single AI-powered experience built on Databricks. The ProblemWhen people travel or plan activities, they often face three common challenges:Activit...
While AI and LLMs take the headlines, hardcore data engineers know that SQL remains the operational backbone of enterprise pipelines. Databricks just rolled out several powerful programmatic and geospatial updates that solve real-world, complex data ...
What if a data pipeline could explain why, it failed instead of just saying it failed? While learning Databricks and exploring Data Engineering, I built an AI Powered Autonomous Data Reliability Platform on Databricks Free Edition using: PySpark Delt...
Hi Everyone! This is my official submission for DAIS 2026 Community Virtual Contest!Deal2Delivery: How I Built an End-to-End AI Sales Intelligence Platform on DatabricksEvery sales team has the same nightmare: a deal closes, and then nobody knows if ...
Let Me Guess What Happened to YouYou built a solid data pipeline. It runs every day, ingests a few gigabytes, everything looks fine. Then one morning you open your cloud storage bill — AWS S3, Azure ADLS, or Google Cloud Storage — and something feels...
Databricks is no longer just a big data platform.It’s becoming the primary platform solution for companies to bring together their data, AI, analytics, and machine learning — all in one ecosystem.Built on Apache Spark, Databricks transformed how orga...
@tushar_sable Well I guess you're seeing it now buddy - DB has already been a complete package!
| User | Count |
|---|---|
| 85 | |
| 73 | |
| 54 | |
| 44 | |
| 42 |
