Skip to content

Commit 244f4b5

Browse files
authored
chore(model gallery): add selene-1-mini-llama-3.1-8b (#4719)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent f1d6d65 commit 244f4b5

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed

gallery/index.yaml

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5359,6 +5359,29 @@
53595359
- filename: deepseek-r1-distill-llama-8b-Q4_K_M.gguf
53605360
sha256: f8eba201522ab44b79bc54166126bfaf836111ff4cbf2d13c59c3b57da10573b
53615361
uri: huggingface://unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF/DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf
5362+
- !!merge <<: *llama31
5363+
name: "selene-1-mini-llama-3.1-8b"
5364+
icon: https://atla-ai.notion.site/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2Ff08e6e70-73af-4363-9621-90e906b92ebc%2F1bfb4316-1ce6-40a0-800c-253739cfcdeb%2Fatla_white3x.svg?table=block&id=17c309d1-7745-80f9-8f60-e755409acd8d&spaceId=f08e6e70-73af-4363-9621-90e906b92ebc&userId=&cache=v2
5365+
urls:
5366+
- https://huggingface.co/AtlaAI/Selene-1-Mini-Llama-3.1-8B
5367+
- https://huggingface.co/bartowski/Selene-1-Mini-Llama-3.1-8B-GGUF
5368+
description: |
5369+
Atla Selene Mini is a state-of-the-art small language model-as-a-judge (SLMJ). Selene Mini achieves comparable performance to models 10x its size, outperforming GPT-4o on RewardBench, EvalBiasBench, and AutoJ.
5370+
5371+
Post-trained from Llama-3.1-8B across a wide range of evaluation tasks and scoring criteria, Selene Mini outperforms prior small models overall across 11 benchmarks covering three different types of tasks:
5372+
5373+
Absolute scoring, e.g. "Evaluate the harmlessness of this response on a scale of 1-5"
5374+
Classification, e.g. "Does this response address the user query? Answer Yes or No."
5375+
Pairwise preference. e.g. "Which of the following responses is more logically consistent - A or B?"
5376+
5377+
It is also the #1 8B generative model on RewardBench.
5378+
overrides:
5379+
parameters:
5380+
model: Selene-1-Mini-Llama-3.1-8B-Q4_K_M.gguf
5381+
files:
5382+
- filename: Selene-1-Mini-Llama-3.1-8B-Q4_K_M.gguf
5383+
sha256: 908e6ce19f7cd3d7394bd7c38e43de2f228aca6aceda35c7ee70d069ad60493e
5384+
uri: huggingface://bartowski/Selene-1-Mini-Llama-3.1-8B-GGUF/Selene-1-Mini-Llama-3.1-8B-Q4_K_M.gguf
53625385
- &deepseek ## Deepseek
53635386
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"
53645387
name: "deepseek-coder-v2-lite-instruct"

0 commit comments

Comments
 (0)