Incorrect dropped rows count in DLT Event log

erigaud
Honored Contributor

Hello, 

I'm using a DLT pipeline with expectations

expect_or_drop(...)

 To test it, I added files that contain records that should be dropped, and indeed when running the pipeline I can see some rows were dropped.

However when looking at the DLT Event logs, in the field 

details.flow_progress.data_quality.dropped_records

I always get 0, and the number of failing rows are only available in the field 

details.flow_progress.data_quality.expectations.failed_records

Is this the expected behavior ?