topic Lakehouse Monitoring GA: Profile, diagnose, and enforce data quality in Community Articles https://community.databricks.com/t5/community-articles/lakehouse-monitoring-ga-profile-diagnose-and-enforce-data/m-p/78018#M175 <P class=""><SPAN>Lakehouse Monitoring provides automated profiling and a dashboard that visualizes trends and anomalies over time. Track key metrics such as data volume, percent nulls, numerical distribution changes, and categorical distribution. For inference tables, you can monitor model drift and performance metrics like accuracy, F1 score, precision and recall to determine when retraining is needed.</SPAN></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="AjayPandey_0-1720668179744.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/9449iB2C9FB58AA4756A1/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="AjayPandey_0-1720668179744.png" alt="AjayPandey_0-1720668179744.png" /></span></P><P>&nbsp;</P> Thu, 11 Jul 2024 03:23:11 GMT Ajay-Pandey 2024-07-11T03:23:11Z Lakehouse Monitoring GA: Profile, diagnose, and enforce data quality https://community.databricks.com/t5/community-articles/lakehouse-monitoring-ga-profile-diagnose-and-enforce-data/m-p/78018#M175 <P class=""><SPAN>Lakehouse Monitoring provides automated profiling and a dashboard that visualizes trends and anomalies over time. Track key metrics such as data volume, percent nulls, numerical distribution changes, and categorical distribution. For inference tables, you can monitor model drift and performance metrics like accuracy, F1 score, precision and recall to determine when retraining is needed.</SPAN></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="AjayPandey_0-1720668179744.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/9449iB2C9FB58AA4756A1/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="AjayPandey_0-1720668179744.png" alt="AjayPandey_0-1720668179744.png" /></span></P><P>&nbsp;</P> Thu, 11 Jul 2024 03:23:11 GMT https://community.databricks.com/t5/community-articles/lakehouse-monitoring-ga-profile-diagnose-and-enforce-data/m-p/78018#M175 Ajay-Pandey 2024-07-11T03:23:11Z