Hello everyone,

I couldn't find a topic on this - what are your best practices to ensuring data quality in batch pipelines?

I've got a big pipeline processing data once per day. We though about either going with DBT or DLT but DLT seems more directed for streaming, not daily batches. DBT adds additional complexity but is good for batches though.

Can you share your thoughts on this and how you do it?