What is difference between _RAW tables and _APPEND_RAW tables of Bronze-Layer of Azure Databricks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-12-2024 02:04 AM - edited 07-12-2024 03:11 AM
Hi Team,
I would like to know difference between _RAW tables and _APPEND_RAW tables of Bronze-Layer.
As both are STREAMING Tables then why we need 2 separate tables.
Note: we are following Medalion Architecture. Also above tables are created via Delta Live Tables pipeline. so they are basically DLT Tables.
Thanks
Devsql
- Labels:
-
Delta Lake
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-12-2024 02:30 AM
I don't exactly understand your question, so let me try to give you a generic answer. You don't need to do anything, if you're fine with working with one table, then just go with one.
An append-only table, as the name suggests, will only contain insert operations. By using the table property "delta.appendOnly" you can also force it.
And "a not-only append" table, obviously, might contain next to inserts, also updates and deletes.
In general, there's no right or wrong answer, as it highly depends on your use case/architecture.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-12-2024 03:12 AM
Hi @Witold , I updated last line of my above post, added below lines: Also above tables are created via Delta Live Tables pipeline. so they are basically DLT Tables. Hope this gives you proper idea.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-12-2024 04:00 AM
Hi @Retired_mod , I saw your replies to other posts, so thought to ask you....would you like to help me on this...!!!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-16-2024 07:01 AM
Thank you very much @Retired_mod for this excellent answer.

