Populate client_request_id in Model Serving inference table

RobinK — Fri, 13 Sep 2024 07:59:16 GMT

Hi,

The documentation for the model serving inference table states that the client_request_id column is typically null. How can I populate this column with a request ID from the calling .NET application when invoking the model via the Databricks REST API?

See https://docs.databricks.com/en/generative-ai/deploy-agent.html

Column nameTypeDescription

client_request_id

String

Client request ID, usually null.

Re: Populate client_request_id in Model Serving inference table

RobinK — Tue, 01 Oct 2024 06:31:31 GMT

I finally found it in the docs: https://docs.databricks.com/en/machine-learning/model-serving/inference-tables.html#specify-client_request_id

{
  "client_request_id": "<user-provided-id>",
  "dataframe_records": [...]
}

topic Populate client_request_id in Model Serving inference table in Machine Learning

Populate client_request_id in Model Serving inference table

Re: Populate client_request_id in Model Serving inference table