From the Databricks Hackathon to the Databricks Community!

Data Engineering

Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.

Back in March 2026, I participated in a Databricks hackathon, where I had the opportunity to build a solution using Databricks and explore its capabilities in solving real-world problems.

I'm excited to share that my project secured a place among the Top 100 out of 18,000+ participants! 🎉

The experience was a great opportunity to experiment, learn, and push my technical skills further.

Now, as I join the Databricks Community, I'm looking forward to sharing more about the project, discussing the technical challenges I encountered, and learning from fellow data and AI practitioners.

🔗 Project: https://github.com/DevashishK26/Smart-Manufacturing-IoT-Lakehouse

I'd love to hear your thoughts and feedback!

#Databricks #DataEngineering #DataScience #AI #Hackathon

Making data behave, one pipeline at a time. (Still debugging)
- Devashish

End-to-end Smart Manufacturing Lakehouse built on Databricks using Medallion architecture (Bronze-Silver-Gold). Ingests synthetic IoT and operational data, applies data quality rules, builds a star schema, simulates row/column-level security, and optimizes Delta tables with ZORDER. Fully ...