Skip to content

Commit cad7e9a

Browse files
authored
chore(model gallery): add 14b-qwen2.5-freya-x1 (#4566)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 4426efa commit cad7e9a

File tree

1 file changed

+24
-0
lines changed

1 file changed

+24
-0
lines changed

gallery/index.yaml

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2849,6 +2849,30 @@
28492849
- filename: Dolphin3.0-Qwen2.5-3b-Q4_K_M.gguf
28502850
sha256: 0cb1908c5f444e1dc2c5b5619d62ac4957a22ad39cd42f2d0b48e2d8b1c358ab
28512851
uri: huggingface://bartowski/Dolphin3.0-Qwen2.5-3b-GGUF/Dolphin3.0-Qwen2.5-3b-Q4_K_M.gguf
2852+
- !!merge <<: *qwen25
2853+
name: "14b-qwen2.5-freya-x1"
2854+
icon: https://huggingface.co/Sao10K/14B-Qwen2.5-Freya-x1/resolve/main/sad.png
2855+
urls:
2856+
- https://huggingface.co/Sao10K/14B-Qwen2.5-Freya-x1
2857+
- https://huggingface.co/DevQuasar/Sao10K.14B-Qwen2.5-Freya-x1-GGUF
2858+
description: |
2859+
I decided to mess around with training methods again, considering the re-emegence of methods like multi-step training. Some people began doing it again, and so, why not? Inspired by AshhLimaRP's methology but done it my way.
2860+
Freya-S1
2861+
2862+
LoRA Trained on ~1.1GB of literature and raw text over Qwen 2.5's base model.
2863+
Cleaned text and literature as best as I could, still, may have had issues here and there.
2864+
2865+
Freya-S2
2866+
2867+
The first LoRA was applied over Qwen 2.5 Instruct, then I trained on top of that.
2868+
Reduced LoRA rank because it's mainly instruct and other details I won't get into.
2869+
overrides:
2870+
parameters:
2871+
model: Sao10K.14B-Qwen2.5-Freya-x1.Q4_K_M.gguf
2872+
files:
2873+
- filename: Sao10K.14B-Qwen2.5-Freya-x1.Q4_K_M.gguf
2874+
sha256: 790953e2ffccf2f730d52072f300fba9d1549c7762f5127b2014cdc82204b509
2875+
uri: huggingface://DevQuasar/Sao10K.14B-Qwen2.5-Freya-x1-GGUF/Sao10K.14B-Qwen2.5-Freya-x1.Q4_K_M.gguf
28522876
- &smollm
28532877
## SmolLM
28542878
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"

0 commit comments

Comments
 (0)