bianca_unifeye
Databricks MVP

 Kudos to you for diving into Databricks so quickly and already covering so many core concepts! That’s a fantastic foundation, you’ve clearly built an understanding of both the platform and its ecosystem (Lakehouse, Delta Lake, and MLflow are key pillars).

Suggestion: a great next step would be to build a simple data pipeline using the Medallion Architecture. For example:

  • Bronze: Ingest raw CSV/JSON data (like public datasets from Kaggle).

  • Silver: Clean and transform it with Spark (handle nulls, deduplicate, enrich).

  • Gold: Aggregate the data for insights, maybe a small dashboard or BI visualization.

Then, you can layer in MLflow to track a basic ML model (like predicting sales or ratings). It’s the perfect beginner-friendly project that connects all the concepts you’ve learned so far.

Keep going! You’re already thinking like a data engineer 
#KeepLearning #Databricks #Lakehouse #DataEngineering

View solution in original post