Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Wednesday
From my understanding, the DLT or SDP expectations are restricted to the pipelines. So if you have these Spark Declarative Pipelines, using the in-built expectations is a no-brainer. Whereas, DQX can be applied almost anywhere in your notebooks, workflows etc. The flexibility and the variety of DQ checks available via DQX made us choose that as in our case SDP pipelines weren't being used.