https://community.databricks.com/t5/generative-ai/ai-query-and-cached-tokens/m-p/153984#M1743 <P>Is ai_query actually able to use OpenAI's cached tokens? I was not unable to prove it. The response object from ai_query does not contain the raw response, and when I re-run an identical request via OpenAI SDK (identical model, settings etc.) and examine the response, cached_tokens = 0, which indicates that caching doe snot work in this setup, for whatever reason.</P> Thu, 09 Apr 2026 19:30:11 GMT samuel86 2026-04-09T19:30:11Z https://community.databricks.com/t5/generative-ai/ai-query-and-cached-tokens/m-p/153984#M1743 <P>Is ai_query actually able to use OpenAI's cached tokens? I was not unable to prove it. The response object from ai_query does not contain the raw response, and when I re-run an identical request via OpenAI SDK (identical model, settings etc.) and examine the response, cached_tokens = 0, which indicates that caching doe snot work in this setup, for whatever reason.</P> Thu, 09 Apr 2026 19:30:11 GMT https://community.databricks.com/t5/generative-ai/ai-query-and-cached-tokens/m-p/153984#M1743 samuel86 2026-04-09T19:30:11Z