Skip to content

Vertex thinking differs from the standardized thinking response from the gateway #1112

Closed
@narengogi

Description

@narengogi

What Happened?

the gateway follows anthropics signature for returning thinking model responses (https://portkey.ai/docs/integrations/llms/anthropic#extended-thinking-reasoning-models-beta)

However this signature is not followed for gemini models, support for which was added prior to the gateway picking up anthropic signature.
Also google flip flopped between outputting reasoning text and then shutting down reasoning in response and their signature has been slightly modified

What Should Have Happened?

No response

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions