topic How do you detect model drift using Databricks? in Data Engineering https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/25698#M17925 Mon, 07 Jun 2021 23:36:53 GMT User16789201666 2021-06-07T23:36:53Z How do you detect model drift using Databricks? https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/25698#M17925 Mon, 07 Jun 2021 23:36:53 GMT https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/25698#M17925 User16789201666 2021-06-07T23:36:53Z Re: How do you detect model drift using Databricks? https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/25699#M17926 <P>Here's an old blog on this topic. We're actively working on a MLFlow based solution to this problem.</P> Mon, 07 Jun 2021 23:38:54 GMT https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/25699#M17926 User16789201666 2021-06-07T23:38:54Z Re: How do you detect model drift using Databricks? https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/25700#M17927 <P>Here's a good presentation from DAIS 2021 - Drifting Away: Testing ML Models in Production</P><UL><LI><A href="https://databricks.com/session_na21/drifting-away-testing-ml-models-in-production" target="test_blank">https://databricks.com/session_na21/drifting-away-testing-ml-models-in-production</A></LI><LI><A href="https://github.com/chengyin38/dais_2021_drifting_away" target="test_blank">https://github.com/chengyin38/dais_2021_drifting_away</A></LI></UL> Fri, 18 Jun 2021 03:22:30 GMT https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/25700#M17927 User16783853898 2021-06-18T03:22:30Z Re: How do you detect model drift using Databricks? https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/49209#M28494 <P>Use Lakehouse Monitoring:&nbsp;&nbsp;<A href="https://docs.databricks.com/en/lakehouse-monitoring/index.html" target="_blank">https://docs.databricks.com/en/lakehouse-monitoring/index.html</A></P> <P>Specifically:&nbsp;</P> <P><A href="https://docs.databricks.com/en/lakehouse-monitoring/monitor-output.html#drift-metrics-table" target="_blank">https://docs.databricks.com/en/lakehouse-monitoring/monitor-output.html#drift-metrics-table</A></P> Sun, 15 Oct 2023 10:24:51 GMT https://community.databricks.com/t5/data-engineering/how-do-you-detect-model-drift-using-databricks/m-p/49209#M28494 arun_pamulapati 2023-10-15T10:24:51Z