Skip to content

chore(model gallery): add steelskull_l3.3-san-mai-r1-70b #4893

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Feb 24, 2025
Merged

chore(model gallery): add steelskull_l3.3-san-mai-r1-70b #4893

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 25 additions & 0 deletions gallery/index.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1628,7 +1628,7 @@
sha256: 770900ba9594f64f31b35fe444d31263712cabe167efaf4201d79fdc29de9533
uri: huggingface://mradermacher/kubeguru-llama3.2-3b-v0.1-GGUF/kubeguru-llama3.2-3b-v0.1.Q4_K_M.gguf
- &qwen25
name: "qwen2.5-14b-instruct" ## Qwen2.5

Check warning on line 1631 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

1631:32 [comments] too few spaces before comment
icon: https://avatars.githubusercontent.com/u/141221163
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
license: apache-2.0
Expand Down Expand Up @@ -3589,7 +3589,7 @@
sha256: 0fec82625f74a9a340837de7af287b1d9042e5aeb70cda2621426db99958b0af
uri: huggingface://bartowski/Chuluun-Qwen2.5-72B-v0.08-GGUF/Chuluun-Qwen2.5-72B-v0.08-Q4_K_M.gguf
- &smollm
url: "github:mudler/LocalAI/gallery/chatml.yaml@master" ## SmolLM

Check warning on line 3592 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

3592:59 [comments] too few spaces before comment
name: "smollm-1.7b-instruct"
icon: https://huggingface.co/datasets/HuggingFaceTB/images/resolve/main/banner_smol.png
tags:
Expand Down Expand Up @@ -4096,7 +4096,7 @@
sha256: f769c6e1a85d3426263f585f640a90c10e7e26b89345a700a4cabf62eb0583d4
uri: huggingface://bartowski/ozone-ai_Reverb-7b-GGUF/ozone-ai_Reverb-7b-Q4_K_M.gguf
- &llama31
url: "github:mudler/LocalAI/gallery/llama3.1-instruct.yaml@master" ## LLama3.1

Check warning on line 4099 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

4099:70 [comments] too few spaces before comment
icon: https://avatars.githubusercontent.com/u/153379578
name: "meta-llama-3.1-8b-instruct"
license: llama3.1
Expand Down Expand Up @@ -6117,7 +6117,7 @@
sha256: 0e8d44a92153cda0c6a5d6b0d9af44d4806104b39d3232f9097cfcc384a78152
uri: huggingface://Triangle104/L3.1-8b-RP-Ink-Q4_K_M-GGUF/l3.1-8b-rp-ink-q4_k_m.gguf
- &deepseek
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master" ## Deepseek

Check warning on line 6120 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

6120:61 [comments] too few spaces before comment
name: "deepseek-coder-v2-lite-instruct"
icon: "https://avatars.githubusercontent.com/u/148330874"
license: deepseek
Expand Down Expand Up @@ -6182,7 +6182,7 @@
sha256: a47782c55ef2b39b19644213720a599d9849511a73c9ebb0c1de749383c0a0f8
uri: huggingface://RichardErkhov/ContextualAI_-_archangel_sft_pythia2-8b-gguf/archangel_sft_pythia2-8b.Q4_K_M.gguf
- &deepseek-r1
url: "github:mudler/LocalAI/gallery/deepseek-r1.yaml@master" ## Start DeepSeek-R1

Check warning on line 6185 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

6185:64 [comments] too few spaces before comment
name: "deepseek-r1-distill-qwen-1.5b"
icon: "https://avatars.githubusercontent.com/u/148330874"
urls:
Expand Down Expand Up @@ -6439,8 +6439,33 @@
- filename: arcee-ai_Arcee-Maestro-7B-Preview-Q4_K_M.gguf
sha256: 7b1099e67ad1d10a80868ca0c39e78e7b3f89da87aa316166f56cc259e53cb7f
uri: huggingface://bartowski/arcee-ai_Arcee-Maestro-7B-Preview-GGUF/arcee-ai_Arcee-Maestro-7B-Preview-Q4_K_M.gguf
- !!merge <<: *deepseek-r1
name: "steelskull_l3.3-san-mai-r1-70b"
icon: https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/8fZQZaLM0XO9TyKh-yMQ7.jpeg
urls:
- https://huggingface.co/Steelskull/L3.3-San-Mai-R1-70b
- https://huggingface.co/bartowski/Steelskull_L3.3-San-Mai-R1-70b-GGUF
description: |
L3.3-San-Mai-R1-70b represents the foundational release in a three-part model series, followed by L3.3-Cu-Mai-R1-70b (Version A) and L3.3-Mokume-Gane-R1-70b (Version C). The name "San-Mai" draws inspiration from the Japanese bladesmithing technique of creating three-layer laminated composite metals, known for combining a hard cutting edge with a tougher spine - a metaphor for this model's balanced approach to AI capabilities.
Built on a custom DeepSeek R1 Distill base (DS-Hydroblated-R1-v4.1), San-Mai-R1 integrates specialized components through the SCE merge method:

EVA and EURYALE foundations for creative expression and scene comprehension
Cirrus and Hanami elements for enhanced reasoning capabilities
Anubis components for detailed scene description
Negative_LLAMA integration for balanced perspective and response

Core Capabilities

As the OG model in the series, San-Mai-R1 serves as the gold standard and reliable baseline. User feedback consistently highlights its superior intelligence, coherence, and unique ability to provide deep character insights. Through proper prompting, the model demonstrates advanced reasoning capabilities and an "X-factor" that enables unprompted exploration of character inner thoughts and motivations.
overrides:
parameters:
model: Steelskull_L3.3-San-Mai-R1-70b-Q4_K_M.gguf
files:
- filename: Steelskull_L3.3-San-Mai-R1-70b-Q4_K_M.gguf
sha256: 2287bfa14af188b0fc3a9f4e3afc9c303b7c41cee49238434f971c090b850306
uri: huggingface://bartowski/Steelskull_L3.3-San-Mai-R1-70b-GGUF/Steelskull_L3.3-San-Mai-R1-70b-Q4_K_M.gguf
- &qwen2
url: "github:mudler/LocalAI/gallery/chatml.yaml@master" ## Start QWEN2

Check warning on line 6468 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

6468:59 [comments] too few spaces before comment
name: "qwen2-7b-instruct"
icon: https://avatars.githubusercontent.com/u/141221163
license: apache-2.0
Expand Down Expand Up @@ -6841,7 +6866,7 @@
sha256: dbffc989d12d42ef8e4a2994e102d7ec7a02c49ec08ea2e35426372ad07b4cd8
uri: huggingface://bartowski/TAID-LLM-1.5B-GGUF/TAID-LLM-1.5B-Q4_K_M.gguf
- &mistral03
url: "github:mudler/LocalAI/gallery/mistral-0.3.yaml@master" ## START Mistral

Check warning on line 6869 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

6869:64 [comments] too few spaces before comment
name: "mistral-7b-instruct-v0.3"
icon: https://cdn-avatars.huggingface.co/v1/production/uploads/62dac1c7a8ead43d20e3e17a/wrLf5yaGC6ng4XME70w6Z.png
license: apache-2.0
Expand Down Expand Up @@ -7610,7 +7635,7 @@
sha256: 6358033ea52dbde158dbcdb44bd68b2b8959cc77514c86a9ccc64ba1a452f287
uri: huggingface://bartowski/PocketDoc_Dans-PersonalityEngine-V1.2.0-24b-GGUF/PocketDoc_Dans-PersonalityEngine-V1.2.0-24b-Q4_K_M.gguf
- &mudler
url: "github:mudler/LocalAI/gallery/mudler.yaml@master" ### START mudler's LocalAI specific-models

Check warning on line 7638 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

7638:59 [comments] too few spaces before comment
name: "LocalAI-llama3-8b-function-call-v0.2"
icon: "https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/us5JKi9z046p8K-cn_M0w.webp"
license: llama3
Expand Down Expand Up @@ -7655,7 +7680,7 @@
sha256: 579cbb229f9c11d0330759ff4733102d2491615a4c61289e26c09d1b3a583fec
uri: huggingface://mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF/Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_m.bin
- &parler-tts
url: "github:mudler/LocalAI/gallery/parler-tts.yaml@master" ### START parler-tts

Check warning on line 7683 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

7683:63 [comments] too few spaces before comment
name: parler-tts-mini-v0.1
overrides:
parameters:
Expand All @@ -7672,7 +7697,7 @@
- text-to-speech
- python
- &rerankers
url: "github:mudler/LocalAI/gallery/rerankers.yaml@master" ### START rerankers

Check warning on line 7700 in gallery/index.yaml

View workflow job for this annotation

GitHub Actions / Yamllint 

7700:62 [comments] too few spaces before comment
name: cross-encoder
parameters:
model: cross-encoder
Expand Down
Loading