https://community.databricks.com/t5/data-engineering/mlflow-model-serving-latency-expectations/m-p/18714#M12453 <P>What are your throughput requirements in addition to latency. Currently this is in private preview and databricks recommends this only for low throughput and non-critical applications. However, as it move towards GA, this would change. Please get in touch with the databricks accounts team </P> Fri, 25 Jun 2021 21:47:58 GMT sajith_appukutt 2021-06-25T21:47:58Z https://community.databricks.com/t5/data-engineering/mlflow-model-serving-latency-expectations/m-p/18713#M12452 <P>What kind of latency should I expect when using the built in model serving capability in MLflow. Evaluating whether it would be a good fit for our use case</P> Fri, 25 Jun 2021 20:50:42 GMT https://community.databricks.com/t5/data-engineering/mlflow-model-serving-latency-expectations/m-p/18713#M12452 User16826992666 2021-06-25T20:50:42Z https://community.databricks.com/t5/data-engineering/mlflow-model-serving-latency-expectations/m-p/18714#M12453 <P>What are your throughput requirements in addition to latency. Currently this is in private preview and databricks recommends this only for low throughput and non-critical applications. However, as it move towards GA, this would change. Please get in touch with the databricks accounts team </P> Fri, 25 Jun 2021 21:47:58 GMT https://community.databricks.com/t5/data-engineering/mlflow-model-serving-latency-expectations/m-p/18714#M12453 sajith_appukutt 2021-06-25T21:47:58Z