cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Can someone explain what a lakehouse is and how it relates to Delta Lake?

sohamdhodapkar
New Contributor
 
4 REPLIES 4

-werners-
Esteemed Contributor III

A lakehouse is an architectural design to build a data warehouse using data lake/big data tools.

So it takes elements from classical data warehousing and skips the whole RDBMS part and inserts other elements like HDFS etc.

So think of it as a data warehouse with modern scale out tools.

Delta lake is a file format which will contain the actual data (think of it as a column store table) based on the Parquet file format, but with added functionality (it is ACID compliant).

How do the two relate?

Well, Delta Lake fits quite well into a lakehouse, especially because delta lake has upsert (MERGE) functionality (that most other file formats lack), change data feed, clones, rollback etc.

It also has several performance enhancing functions which makes it a very suitable file format to build your lakehouse upon.

So when you build a lakehouse, delta lake will probably be part of it (together with parquet and maybe some others).

Kaniz
Community Manager
Community Manager

Hi @Soham Dhodapkarโ€‹, We havenโ€™t heard from you on the last response from @Werner Stinckensโ€‹, and I was checking back to see if his response helped you. Or else, If you have any solution, please share it with the community as it can be helpful to others.

Hubert-Dudek
Esteemed Contributor III

One image says more than 1000 words:

download

Noopur_Nigam
Valued Contributor II
Valued Contributor II

Hi @Soham Dhodapkarโ€‹ https://docs.databricks.com/lakehouse/index.html This document depicts the component of the lakehouse as described in the image shared by @Hubert Dudekโ€‹ .

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.