How do you detect model drift using Databricks?

[User16789201666]

Here's an old blog on this topic. We're actively working on a MLFlow based solution to this problem.

[User16783853898]

Here's a good presentation from DAIS 2021 - Drifting Away: Testing ML Models in Production

• https://databricks.com/session_na21/drifting-away-testing-ml-models-in-production
• https://github.com/chengyin38/dais_2021_drifting_away

[arun_pamulapati · Accepted solution]

Use Lakehouse Monitoring:  https://docs.databricks.com/en/lakehouse-monitoring/index.html

Specifically: 

https://docs.databricks.com/en/lakehouse-monitoring/monitor-output.html#drift-metrics-table