Skip to content

Commit 6e34430

Browse files
authored
chore(model gallery): add chuluun-qwen2.5-72b-v0.01 (#4573)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 0d08aaa commit 6e34430

File tree

1 file changed

+21
-0
lines changed

1 file changed

+21
-0
lines changed

gallery/index.yaml

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2922,6 +2922,27 @@
29222922
- filename: HuatuoGPT-o1-7B-v0.1-Q4_K_M.gguf
29232923
sha256: 8fc4b797a532d67d677e90293175ff1365c91677d06ea27af297bdf5b60c2d1d
29242924
uri: huggingface://bartowski/HuatuoGPT-o1-7B-v0.1-GGUF/HuatuoGPT-o1-7B-v0.1-Q4_K_M.gguf
2925+
- !!merge <<: *qwen25
2926+
name: "chuluun-qwen2.5-72b-v0.01"
2927+
icon: https://huggingface.co/DatToad/Chuluun-Qwen2.5-72B-v0.01/resolve/main/00008-1523559621.png
2928+
urls:
2929+
- https://huggingface.co/DatToad/Chuluun-Qwen2.5-72B-v0.01
2930+
- https://huggingface.co/bartowski/Chuluun-Qwen2.5-72B-v0.01-GGUF
2931+
description: |
2932+
This is a merge of pre-trained language models created using mergekit.
2933+
2934+
The models in this merge are some of my favorites and I found I liked all of them for different reasons. I believe this model is greater than the sum of its parts - it has the storywriting and language of Eva and Kunou, the spiciness of Magnum, and the uncensored intelligence of Tess. It excels in handling multiple characters and keeping their thoughts, speech, and actions separate, including scene changes. It also appears to match dialogue well to the characters and their backgrounds.
2935+
2936+
Model_stock was the method used, it's very straightforward and quite fast, the bottleneck seemed to be my NVMe drive.
2937+
2938+
All source models use ChatML prompt formatting and it responds very well. For testing purposes I am using a temperature of 1.08, rep pen of 0.03, and DRY with 0.6 (most Qwen models seem to need DRY). All other samplers are neutralized.
2939+
overrides:
2940+
parameters:
2941+
model: Chuluun-Qwen2.5-72B-v0.01-Q4_K_M.gguf
2942+
files:
2943+
- filename: Chuluun-Qwen2.5-72B-v0.01-Q4_K_M.gguf
2944+
sha256: 901d9d10aad42de3188e721accdc4eb0efec96cbca48563f802793dceaf551f5
2945+
uri: huggingface://bartowski/Chuluun-Qwen2.5-72B-v0.01-GGUF/Chuluun-Qwen2.5-72B-v0.01-Q4_K_M.gguf
29252946
- &smollm
29262947
## SmolLM
29272948
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"

0 commit comments

Comments
 (0)