ManojkMohan
Honored Contributor II

@vamsi_simbus  DLT captures data quality metrics in specialized system tables known as “event” and “metrics” tables. Specifically, look in the following table:

LIVE.DLT_EVENT_LOG or LIVE.DLT_METRICS: These tables contain granular event logs and metrics, including per-expectation data quality results for each table within your DLT pipeline.  https://docs.databricks.com/aws/en/ldp/expectations

The metrics are available not only at the pipeline level but also for individual expectations applied to specific tables https://community.databricks.com/t5/technical-blog/monitoring-dlt-pipeline-performance-and-best-prac...

Example

ManojkMohan_0-1763366117299.png

Replace LIVE.DLT_EVENT_LOG with the correct schema as used in your environment.
Columns such as table_name, expectation_name, num_violations, and violation_percentage will provide insight into data quality