Skip to content

Commit 27e1e2c

Browse files
committed
fix(hermes-2-pro-mistral): add stopword for toolcall
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 3c778b5 commit 27e1e2c

File tree

4 files changed

+4
-0
lines changed

4 files changed

+4
-0
lines changed

aio/cpu/text-to-text.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ f16: true
4141
stopwords:
4242
- <|im_end|>
4343
- <dummy32000>
44+
- "\n</tool_call>"
4445
usage: |
4546
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
4647
"model": "gpt-4",

aio/gpu-8g/text-to-text.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ f16: true
4141
stopwords:
4242
- <|im_end|>
4343
- <dummy32000>
44+
- "\n</tool_call>"
4445
usage: |
4546
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
4647
"model": "gpt-4",

aio/intel/text-to-text.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,7 @@ template:
4040
context_size: 4096
4141
stopwords:
4242
- <|im_end|>
43+
- "\n</tool_call>"
4344
- <dummy32000>
4445
usage: |
4546
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{

embedded/models/hermes-2-pro-mistral.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ f16: true
4141
stopwords:
4242
- <|im_end|>
4343
- <dummy32000>
44+
- "\n</tool_call>"
4445
usage: |
4546
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
4647
"model": "hermes-2-pro-mistral",

0 commit comments

Comments
 (0)