comprehensive guide or usecases for data engineering hands-on
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yesterday
Hello members,
I have access to my databricks environment and I see it already includes sample data sets (under "samples" database).
I find the learning paths are very basic and not any close the real use cases. Are there any advanced hands-on use cases built around these sample datasets to try?
It would be great if we have some structured guide rather than fragmented topic. Appreciate any recommendation on this topic.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yesterday
Hi Manjunath
How are you doing today? I felt the same way starting out, so I know what you mean. The best structured resource is dbdemos.ai, maintained by the Databricks team. It installs full end to end demos into your workspace in one line (pip install dbdemos, then dbdemos.install), each with real style datasets, pipelines, and dashboards already wired up. Good ones to start with are Lakehouse Retail C360, Delta Live Tables and CDC, and MLOps end to end. One note, if you are on Free Edition, some may not fully install due to compute and outbound limits, so a trial or paid workspace works best.
Alongside that, build one real project on the sample data yourself. Take samples.tpch or nyctaxi, build a proper medallion pipeline (bronze to silver to gold), then put a dashboard or a Genie space on top. Doing one flow end to end teaches you more than ten scattered tutorials.
Hope this helps.
