cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Deleting MLflow runs programmatically

samini
New Contributor II

I would like to programmatically delete some MLflow runs based on a given run id. I am interested in the best practices on how to do this in Databricks workspaces.

I know that MLflow cli has gc command which seems quite useful since it also deletes associated artifacts with a run id. I tried to use that in a Databricks workspace but it gave me an error saying: 

mlflow.exceptions.MlflowException: This cli can only be used with a backend that allows hard-deleting runs

Does anyone have experience with running this command or other best practices deleting runs programmatically?

3 REPLIES 3

Kaniz
Community Manager
Community Manager

Hi @samini, The error message you're seeing indicates that the MLflow CLI garbage collection (gc) command is not supported by the backend store that's being used by your Databricks workspace.

samini
New Contributor II

Hi, it does indeed suggest that. But, is it something configurable in Databricks workspaces? I tried to find a setting in the Admin Settings tab, but I couldn't find anything.

mameli
New Contributor II

Do we have any updates on this? i'm using databricks and I have the same MlflowException

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!