cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
trickywhitecat
by • New Contributor
  • 390 Views
  • 1 replies
  • 0 kudos

Petition to update your documentation about inferencing LLMs and standardize LLM response format

TL;DRInconsistent & Undocumented Response Format: Contrary to Databricks documentation, enabling thinking.type for Gemini 2.5 Flash changes the ChatCompletion content field from a standard string to a list of dictionaries, breaking expected behavior....

Generative AI
Reply
  • 390 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Hey @trickywhitecat , You're right that when thinking.type is enabled for Gemini 2.5 Flash on a Databricks serving endpoint, the content field comes back as a list of dictionaries instead of a plain string. That breaks the expected OpenAI ChatComplet...

  • 0 kudos
Labels