How to turn thinking on in IBM Granite 3.2 #195
Unanswered
PaulBlenkhorn
asked this question in
Q&A
Replies: 1 comment 1 reply
-
I don't know much about this model but I found a convo here where they say you'll have to add an additional message: |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
IBM have recently released Granite 3.2 (https://www.ibm.com/new/announcements/ibm-granite-3-2-open-source-reasoning-and-vision). they say <IBM Granite 3.2 Instruct models allow their extended thought process to be toggled on or off by simply adding the parameter "thinking":true or "thinking":false to the API endpoint>.
I can't find a way to start a chat and set the parameter. I'm sure this is very straightforward and I'm missing something really obvious. Can anyone tell me how to do this?
Beta Was this translation helpful? Give feedback.
All reactions