Skip to content

Commit 0586fe2

Browse files
authored
models(gallery): add opencoder-8b instruct and base (#4101)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent f1e03bf commit 0586fe2

File tree

1 file changed

+38
-0
lines changed

1 file changed

+38
-0
lines changed

gallery/index.yaml

Lines changed: 38 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,42 @@
11
---
2+
- &opencoder
3+
name: "opencoder-8b-base"
4+
icon: https://github.com/OpenCoder-llm/opencoder-llm.github.io/blob/main/static/images/opencoder_icon.jpg?raw=true
5+
url: "github:mudler/LocalAI/gallery/codellama.yaml@master"
6+
urls:
7+
- https://huggingface.co/infly/OpenCoder-8B-Base
8+
- https://huggingface.co/QuantFactory/OpenCoder-8B-Base-GGUF
9+
tags:
10+
- llm
11+
- gguf
12+
- gpu
13+
- cpu
14+
- code
15+
license: inf
16+
description: |
17+
The model is a quantized version of infly/OpenCoder-8B-Base created using llama.cpp. It is part of the OpenCoder LLM family which includes 1.5B and 8B base and chat models, supporting both English and Chinese languages. The original OpenCoder model was pretrained on 2.5 trillion tokens composed of 90% raw code and 10% code-related web data, and supervised finetuned on over 4.5M high-quality SFT examples. It achieves high performance across multiple language model benchmarks and is one of the most comprehensively open-sourced models available.
18+
overrides:
19+
parameters:
20+
model: OpenCoder-8B-Base.Q4_K_M.gguf
21+
files:
22+
- filename: OpenCoder-8B-Base.Q4_K_M.gguf
23+
sha256: ed158a6f72a40cf4f3f4569f649b365f5851e93f03b56252af3906515fab94ec
24+
uri: huggingface://QuantFactory/OpenCoder-8B-Base-GGUF/OpenCoder-8B-Base.Q4_K_M.gguf
25+
- !!merge <<: *opencoder
26+
url: "github:mudler/LocalAI/gallery/hermes-2-pro-mistral.yaml@master"
27+
name: "opencoder-8b-instruct"
28+
urls:
29+
- https://huggingface.co/infly/OpenCoder-8B-Instruct
30+
- https://huggingface.co/QuantFactory/OpenCoder-8B-Instruct-GGUF
31+
description: |
32+
The LLM model is QuantFactory/OpenCoder-8B-Instruct-GGUF, which is a quantized version of infly/OpenCoder-8B-Instruct. It is created using llama.cpp and supports both English and Chinese languages. The original model, infly/OpenCoder-8B-Instruct, is pretrained on 2.5 trillion tokens composed of 90% raw code and 10% code-related web data, and supervised finetuned on over 4.5M high-quality SFT examples. It achieves high performance across multiple language model benchmarks and is one of the leading open-source models for code.
33+
overrides:
34+
parameters:
35+
model: OpenCoder-8B-Instruct.Q4_K_M.gguf
36+
files:
37+
- filename: OpenCoder-8B-Instruct.Q4_K_M.gguf
38+
sha256: ae642656f127e339fcb9566e6039a73cc55d34e3bf59e067d58ad40742f49f00
39+
uri: huggingface://QuantFactory/OpenCoder-8B-Instruct-GGUF/OpenCoder-8B-Instruct.Q4_K_M.gguf
240
- &granite3
341
name: "granite-3.0-1b-a400m-instruct"
442
urls:

0 commit comments

Comments
 (0)