cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Are data health check expectations available only on Delta Live tables?

Oliver_Angelil
Valued Contributor II

I love the idea of "expectations" being available for Delta Live tables: https://docs.databricks.com/delta-live-tables/expectations.html

I'd like to know if they are also available for regular delta tables?

Thank you in advance!

1 ACCEPTED SOLUTION

Accepted Solutions

Oliver_Angelil
Valued Contributor II

Delta Live Tables (DLT) are a framework for ELT, not a format of tables. Tables will still be in "Delta" (Delta Lake) format. Expectations are part of the DLT framework.

View solution in original post

4 REPLIES 4

Kaniz
Community Manager
Community Manager

Hi @Oliver Angelil​ , Expectations are optional clauses you add to Delta Live Tables dataset declarations that apply data quality checks on each record passing through a query.

Anonymous
Not applicable

Hi @Oliver Angelil​ 

We haven't heard from you since the last response from @Kaniz Fatma​ ​, and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others. 

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Oliver_Angelil
Valued Contributor II

Delta Live Tables (DLT) are a framework for ELT, not a format of tables. Tables will still be in "Delta" (Delta Lake) format. Expectations are part of the DLT framework.

erigaud
Honored Contributor

Hello @Oliver_Angelil, so have you found a way to implement something resembling expectations for delta tables outside of a DLT pipeline ? 

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.