Build a solid, practical foundation in modern data ingestion on Databricks with this free, self-paced Data Ingestion with Lakeflow Connect course, designed for data engineers working with cloud storage, Delta Lake, and Medallion architectures.
What you’ll learn:
- Lakeflow Connect Fundamentals: Understand Lakeflow Connect as a scalable, simplified way to ingest data from diverse sources into Databricks, and how it fits with Delta tables and the Medallion architecture.
- Cloud storage Ingestion: Learn when and how to use CTAS, COPY INTO, and Auto Loader to ingest data from cloud object storage into Delta tables, including how to capture file metadata in bronze tables and handle rescued (malformed) records.
- Enterprise-grade Ingestion Patterns: Explore Standard vs. Managed Connectors, ingest and flatten semi-structured JSON, and see how to pull data from enterprise systems using Lakeflow Connect Managed Connectors.
- Alternative Ingestion Strategies: Dive into MERGE INTO–based patterns and discover how to leverage the Databricks Marketplace as additional ingestion options.
- Hands-on, Architecture-aware Mindset: Tie it all together with Medallion design principles, rescued data strategies, and ingestion patterns that support reliable downstream analytics and ML.
Who should take this course?
This course is ideal if you:
- Work as a data engineer or analytics engineer on Databricks
- Already know basic SQL, Python, Spark, Delta Lake, Unity Catalog, and Medallion concepts
- Want to standardize ingestion into Delta using Lakeflow Connect instead of ad hoc scripts
Course format & details:
- Duration: ~2 hours, 4 sections, 23 lessons
- Level: Associate
- Role: Data Engineer
- Format: E-learning (slides + notes, with demo videos retained)
- Cost: Free!
- Labs: Not included (concept and pattern-focused)
- Runs on: DBR 14.3 (not supported on Community Edition)
The course follows Databricks Academy’s new streamlined format (PDF slides + notes), and your feedback via the end-of-course survey will directly shape future Academy content.
Ready to level up your ingestion skills with Lakeflow Connect?
Enroll for “Data Ingestion with Lakeflow Connect” in Databricks Academy, and don’t forget to showcase your achievement on your LinkedIn profile or your resume.
