topic Create Databricks Dashboards on MLFlow Metrics in Machine Learning

Create Databricks Dashboards on MLFlow Metrics

rahuja — Sat, 06 Jul 2024 21:38:34 GMT

Hello

Currently we have multiple ML models running in Production which are logging metrics and other meta-data on mlflow. I wanted to ask is it possible somehow to build Databricks dashboards on top of this data and also can this data be somehow available as databricks tables to do some analysis on it?

#machinelearning #mlflow #databricks

Re: Create Databricks Dashboards on MLFlow Metrics

rahuja — Mon, 08 Jul 2024 14:07:31 GMT

Hello @Retired_mod
Thanks for responding. I think you are talking about using the Python API. But we don't want that is it possible since MLFlow also uses an sql table to store metrics. To expose those tables as a part of our meta-store and build dashboard on top of it? We don't want to use compute for accessing data that is already stored in some DB in the backend.