Random/Rare Bad Request error with Agent Serving endpoint

[Rajat-TVSM]

Whats the reason behind receiving below error at some rare occassions (once in a month)?

"error_code": "BAD_REQUEST", "message": "Encountered an unexpected error while evaluating the model. Verify that the input is compatible with the model for inference.

Not able to reproduce the error with same request.

[KaushalVachhani]

@Rajat-TVSM , The error usually suggests incompatibility between your request payload and what the model expects.

However, if you have verified that the same payload no longer reproduces the issue, it will be challenging to identify the root cause. You can wait to see if the issue occurs more frequently, which may help identify a pattern.

[iyashk-DB]

@Rajat-TVSM 

That message is the generic model-serving “bad request” wrapper we return when a predict operation fails or the request doesn’t match the model’s expected input. The quickest way forward is to validate your payload against the model signature and inspect the endpoint’s inference logs to pinpoint the failure. 

As you have mentioned that this is an Agent Serving endpoint, if you had served the model via the deploy() function,  inference tables are enabled automatically and store payloads.