Add AI Guardrail results into response?

Rjdudley
Honored Contributor

We're considering switching from Azure AI Foundry to Mosaic AI Gateway.  One nice feature AI Foundry has is it adds the content filter results to the response (and in a streaming response, each delta).  This allows us to provide some feedback to the user, and because the filter results are in the response, they end up in the inference table, and we can extract and analyze the results.  We turned on AI Guardrails for some Databricks-hosted models but we don't see any results in the inference tables.  Is there a way to add these results to the response so we can manifest them in our UI?