We can now define Data Quality Alerts and schedule them. We will be notified when an anomaly is detected. It was possible before, but required setting a custom query and using system tables. Additionally, SQL Alert is now a normal Lakeflow job task, so we can, as a next step, trigger a repair job (e.g., backfilling). #databricks
More news https://databrickster.medium.com/

My blog: https://databrickster.medium.com/