Saving failed records with failed expectation name(s)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-14-2024 05:46 AM
Hi all,
I am using Databricks expectations to manage my data quality. But I wanted to save the failed records along side with the expectation name(s) - one or many - that the record failed. The only way I figure out is, not to use Databricks expectation but to build new column for each data quality rule.
Does anyone know of a way to do so with expectations?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-14-2024 06:00 AM
@youcanlearn Have you explore this : https://docs.databricks.com/en/delta-live-tables/expectations.html
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-16-2024 09:12 PM
@iakshaykr yes, but there isnt any concrete examples of implementing it.

