Saving failed records with failed expectation name(s)

youcanlearn
New Contributor III

Hi all,

I am using Databricks expectations to manage my data quality. But I wanted to save the failed records along side with the expectation name(s) - one or many - that the record failed. The only way I figure out is, not to use Databricks expectation but to build new column for each data quality rule.

Does anyone know of a way to do so with expectations?

iakshaykr
New Contributor III

@iakshaykr yes, but there isnt any concrete examples of implementing it.