Skip to content

Commit 326be28

Browse files
authored
chore(model gallery): add ibm-granite_granite-3.2-2b-instruct (#4928)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 0404d98 commit 326be28

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

gallery/index.yaml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1094,6 +1094,21 @@
10941094
- filename: ibm-granite_granite-3.2-8b-instruct-Q4_K_M.gguf
10951095
sha256: bd041eb5bc5e75e4f9a863372000046fd6490374f4dec07f399ca152b1df09c2
10961096
uri: huggingface://bartowski/ibm-granite_granite-3.2-8b-instruct-GGUF/ibm-granite_granite-3.2-8b-instruct-Q4_K_M.gguf
1097+
- !!merge <<: *granite3
1098+
name: "ibm-granite_granite-3.2-2b-instruct"
1099+
url: "github:mudler/LocalAI/gallery/granite3-2.yaml@master"
1100+
urls:
1101+
- https://huggingface.co/ibm-granite/granite-3.2-2b-instruct
1102+
- https://huggingface.co/bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF
1103+
description: |
1104+
Granite-3.2-2B-Instruct is an 2-billion-parameter, long-context AI model fine-tuned for thinking capabilities. Built on top of Granite-3.1-2B-Instruct, it has been trained using a mix of permissively licensed open-source datasets and internally generated synthetic data designed for reasoning tasks. The model allows controllability of its thinking capability, ensuring it is applied only when required.
1105+
overrides:
1106+
parameters:
1107+
model: ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
1108+
files:
1109+
- filename: ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
1110+
sha256: e1b915b0849becf4fdda188dee7b09cbebbfabd71c6f3f2b75dd3eca0a8fded1
1111+
uri: huggingface://bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF/ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
10971112
- name: "moe-girl-1ba-7bt-i1"
10981113
icon: https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/kTXXSSSqpb21rfyOX7FUa.jpeg
10991114
# chatml

0 commit comments

Comments
 (0)