Petition to update your documentation about inferencing LLMs and standardize LLM response format
TL;DRInconsistent & Undocumented Response Format: Contrary to Databricks documentation, enabling thinking.type for Gemini 2.5 Flash changes the ChatCompletion content field from a standard string to a list of dictionaries, breaking expected behavior....
- 324 Views
- 0 replies
- 0 kudos