getting 500 on embedding model invocation call

[tefrati]

I'm getting the following error message "{"error_code": "INTERNAL_ERROR", "message": "The server received an invalid response from an upstream server."}" when making a call to bge-large-en embedding model.

[nayan_wylde]

Seems to me like a rate limit issue. Can you please confirm if the rate limit is not zero.

[tefrati]

I don't see that option on my serving endpoint.
Also, if there's a rate limit, I'd expect to receive a 429 with relevant message and not 500.

[nayan_wylde]

Can you please click on the edit AI gateway it will take you show you the rate limit and share the screenshot

[tefrati]

no rate limitation is enabled

[nayan_wylde]

Yeah your rate limit seems to be good. Can you also check the following points.

1. Use the Databricks-specific name (e.g., databricks-bge-large-en), not the Hugging Face model name. Check in Serving → Endpoints.
2. Validate Payload Format
{ "input": "text to embed" }
3. Test via Databricks UIUse Query endpoint in the Serving page. If that works, issue is client config.

[tefrati]

I have been using databricks-bge-large-en.

Not sure what is meant by client config. I've been using this model for 2 years now. Most of the time it works but today and two days ago is stopped working intermittedly.