taniumalloy
New Contributor III

For the issue I described above, it may be related to the model I am using: "databricks-meta-llama-3-3-70b-instruct". I got it to work by using this on the agent input:

        # messages = [i.model_dump() for i in request.input]
        messages = to_chat_completions_input([i.model_dump() for i in request.input])