cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What is difference between streaming and streaming live table

Kroy
Contributor

Can anyone explain in layman what is difference between Streaming and streaming live table ?

1 ACCEPTED SOLUTION

Accepted Solutions

Atit
Databricks Employee
Databricks Employee

@Kroy  1. Streaming table and 3.Streaming live table are the same; the former is the current syntax; the latter is previous, but is still supported.

View solution in original post

7 REPLIES 7

Lakshay
Databricks Employee
Databricks Employee

Data Loads are broadly classified into two types:

1. Batch load: When the source data is received on schedule, the data load is called as batch load. This is because we have a defined number of rows/ volume of data that needs to be processed at a time.

2. Streaming load: When the source data is received continuously, the data load is called as Streaming load. In this case, there is no fix volume of data that needs to be processed at a time. The data needs to be processed as soon as it is received.

As the two type of loads are quite different, the architectural requirement for the two is also different. A streaming table is just a Delta table that has extra support for a Streaming data load.

Kroy
Contributor

@Lakshay  - Sorry this I Know the difference between batch and streaming load, and I know purpose of streaming table, but here I am looking at difference between streaming and steaming live table

Lakshay
Databricks Employee
Databricks Employee

Hi @Kroy , Sorry I didn't understand your question. I thought you were asking the difference between streaming load and table.

Thanks @Retired_mod  - but how streaming table is different from streaming live table ?

CharlesReily
New Contributor III

Streaming, in a broad sense, refers to the continuous flow of data over a network. It allows you to watch or listen to content in real-time without having to download the entire file first.  A "Streaming Live Table" might refer to a specific type of data presentation or visualization where data in a table format is updated and displayed in real-time as it changes.

What I read about DLT is that , there are three type of tables we can create with keyword

1. Streaming table

2.Live table 

3.Streaming live table

I can relate the difference between streaming live table and live table is that - live table is type of materlised view and streaming live table process data from last process record

what I am not getting is what is difference between streaming table and streaming live table?

Atit
Databricks Employee
Databricks Employee

@Kroy  1. Streaming table and 3.Streaming live table are the same; the former is the current syntax; the latter is previous, but is still supported.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group