cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What is difference between _RAW tables and _APPEND_RAW tables of Bronze-Layer of Azure Databricks

Devsql
New Contributor III

Hi Team,

I would like to know difference between _RAW tables and _APPEND_RAW tables of Bronze-Layer.

As both are STREAMING Tables then why we need 2 separate tables.

Note: we are following Medalion Architecture. Also above tables are created via Delta Live Tables pipeline. so they are basically DLT Tables.

Thanks
Devsql

4 REPLIES 4

Witold
Contributor III

I don't exactly understand your question, so let me try to give you a generic answer. You don't need to do anything, if you're fine with working with one table, then just go with one.

An append-only table, as the name suggests, will only contain insert operations. By using the table property "delta.appendOnly" you can also force it.

And "a not-only append" table, obviously, might contain next to inserts, also updates and deletes.

In general, there's no right or wrong answer, as it highly depends on your use case/architecture.

Devsql
New Contributor III

Hi @Witold , I updated last line of my above post, added below lines: Also above tables are created via Delta Live Tables pipeline. so they are basically DLT Tables. Hope this gives you proper idea.

Devsql
New Contributor III

Hi @Kaniz_Fatma , I saw your replies to other posts, so thought to ask you....would you like to help me on this...!!!

Devsql
New Contributor III

Thank you very much @Kaniz_Fatma for this excellent answer.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group