I'm trying out managed MLflow on Databricks Community edition, with tracking data saved on Databricks and artifacts saved on my own AWS S3 bucket.
I created one experiment and logged 768 runs in the experiment. When I try to get the list of the runs with list_run_infos method, the return maxes out at 399 instead of 768. Is this a limit imposed on Community Edition?
Code:
from mlflow.tracking import MlflowClient
from mlflow.entities import ViewType
client = MlflowClient()
exp_id = client.get_experiment_by_name("exp_name").experiment_id
load_max = 10000
run_list = client.list_run_infos(
experiment_id=exp_id,
run_view_type=ViewType.ACTIVE_ONLY,
max_results=load_max
)
print(len(run_list))
399