topic Re: Are data health check expectations available only on Delta Live tables? in Data Engineering

Are data health check expectations available only on Delta Live tables?

Oliver_Angelil — Tue, 06 Jun 2023 06:35:26 GMT

I love the idea of "expectations" being available for Delta Live tables: https://docs.databricks.com/delta-live-tables/expectations.html

I'd like to know if they are also available for regular delta tables?

Thank you in advance!

Re: Are data health check expectations available only on Delta Live tables?

Anonymous — Tue, 20 Jun 2023 06:10:11 GMT

Hi @Oliver Angelil

We haven't heard from you since the last response from @Kaniz Fatma , and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Re: Are data health check expectations available only on Delta Live tables?

Oliver_Angelil — Tue, 20 Jun 2023 10:06:44 GMT

Delta Live Tables (DLT) are a framework for ELT, not a format of tables. Tables will still be in "Delta" (Delta Lake) format. Expectations are part of the DLT framework.

Re: Are data health check expectations available only on Delta Live tables?

erigaud — Mon, 16 Oct 2023 15:04:52 GMT

Hello @Oliver_Angelil, so have you found a way to implement something resembling expectations for delta tables outside of a DLT pipeline ?