cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Landing Layer vs. Bronze Layer — When to Use Which?

VTiw25
New Contributor II

 

I’ve seen two common approaches in data architectures:

  1. Landing → Bronze: Raw files are first dumped into a landing layer, archived, and then loaded into Delta tables as Bronze.
  2. Raw files = Bronze: The raw file dump itself is treated as the Bronze layer.

Both have their pros and cons, but I haven’t found a clear rule for when to choose one over the other.

What factors should drive this decision? For example, replay/reprocessing needs, retention, governance, data volume, cost, or source-system characteristics.

Would love to hear how others make this decision in real-world data platforms.

Vaibhav
3 REPLIES 3

balajij8
Esteemed Contributor II

@VTiw25 

It hinges on the source reliability and reprocessing needs. You can use a separate landing layer when ingesting from unreliable sources (APIs, third-party SFTP, partner feeds) where data may arrive corrupted, incomplete or need to be rejected before bronze. The landing zone acts as an immutable archive for replaying the exact original state without re-requesting from source. Choose landing when regulatory compliance or audit requirements mandate preserving exact raw files indefinitely, when source systems cannot re deliver historical data or when you need to decouple ingestion cadence from processing. You can skip the landing layer for high volume streaming sources (Kafka), or cases where the source system can replay data on demand. Direct to bronze with Auto Loader or streaming ingestion reduces storage costs and latency.

If schema evolution happens frequently requiring file level reprocessing or governance demands separating data received from data validated, the landing layer is a must. You can implement archival policies (move to cold storage after 30 days etc) to control costs.

saisaranv
New Contributor III

Thank you for your question :

Few factors will decide the approaches to be considered like if data replay, data consistency, data volume and data query patterns from the business etc.,

I am also faced similar situation : for one usecase we directly loaded the data from landing to bronze using autoloader and with `cleanSource` option we archived the data in timewindow basis, another scenario like data is no need of replay and its one time activity or short term activity so considered `Landing` raw files as Bronze.

Final verdict :

1. Data volume, data pattern, incoming payload matters to decide

2. Replay necessity as per business segment give more context to decide.

3. Single time activity or incremental activity ?

masonreed11
New Contributor III

The choice mainly depends on replay, audit, and governance needs. If you need a reliable source of truth for reprocessing, keep raw files separate from Bronze. Otherwise, treating raw files as Bronze can reduce storage, cost, and complexity. Make the decision based on retention requirements, source reliability, data volume, and how often you expect to replay data.