Model Serving - Shadow Deployment - Azure - Databricks Community

Machine Learning

Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.

Hey,

I'm composing an architecture within the usage of Model Serving Endpoints and one of the needs that we're aiming to resolve is Shadow Deployment.

Currently, it seems that the traffic configurations available in model serving do not allow this type of behavior, mixing a mirroring requests effect with "fire and forget" responses from the shadow application.

Do you have this as a feature backlog? Or do you have any already implemented architecture composed within Azure pieces that I could use for that?

Thanks in advance