cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

API limit on mlflow.tracking.client.MlflowClient.list_run_infos method?

j_b
New Contributor

I'm trying out managed MLflow on Databricks Community edition, with tracking data saved on Databricks and artifacts saved on my own AWS S3 bucket.

I created one experiment and logged 768 runs in the experiment. When I try to get the list of the runs with list_run_infos method, the return maxes out at 399 instead of 768. Is this a limit imposed on Community Edition?

Code:

from mlflow.tracking import MlflowClient
from mlflow.entities import ViewType
client = MlflowClient()   
exp_id = client.get_experiment_by_name("exp_name").experiment_id
load_max = 10000
 
run_list = client.list_run_infos(
                          experiment_id=exp_id, 
                          run_view_type=ViewType.ACTIVE_ONLY, 
                          max_results=load_max
) 
print(len(run_list))
399

2 REPLIES 2

sean_owen
Databricks Employee
Databricks Employee

Are 768 of them 'active'? this lists only active runs, according to the method call here.

Note that you should get a paginated result from this method. I am not sure that's the issue here, but the result is not going to be all results.

I don't believe there is otherwise a limit here.

Finally, related, this method is deprecated in favor of search_runs anyway, note.

Anonymous
Not applicable

Hi @jae baak​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group