mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 17:18:49 -04:00
chore(gallery): add MN-CharThink-12B variants
Offer Q4_K_M and Q6_K builds for character roleplay with llama.cpp. Pin downloads and document explicit variant selection. Assisted-by: Codex:gpt-6
This commit is contained in:
1 parent
1cd96e496b
commit
2aaae6cfd3
2 files changed
+82
No files matched your search
@@ -101,6 +101,20 @@ These builds support text chat only: the publisher has no verified vision projec
|
||||
They use standard GGUF files without MTP decoding.
|
||||
See the [model card](https://huggingface.co/ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF) and [Swift Open License v1.0](https://huggingface.co/ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF/blob/main/LICENSE) for usage terms.
|
||||
|
||||
## MN-CharThink-12B-Base
|
||||
|
||||
Install `mn-charthink-12b-base-q4` for character roleplay with llama.cpp.
|
||||
The gallery groups Q4_K_M and Q6_K builds of this 12B Mistral fine-tune.
|
||||
To select Q6_K explicitly, run:
|
||||
|
||||
```bash
|
||||
local-ai models install mn-charthink-12b-base-q4 --variant mn-charthink-12b-base-q6
|
||||
```
|
||||
|
||||
Both builds use the embedded chat template and a 32,768-token default context.
|
||||
The model's `<think>` blocks represent in-character thoughts, memories, and emotional responses.
|
||||
See the [publisher's model card](https://huggingface.co/SvalTek/MN-CharThink-12B-Base) for details.
|
||||
|
||||
## Sharp-Spark-X2.5-4B
|
||||
|
||||
Install `sharp-spark-x2.5-4b` for coding and text chat with llama.cpp.
|
||||
|
||||
@@ -42060,6 +42060,74 @@
|
||||
- filename: MN-Tiramisu-12B.Q5_K_M.gguf
|
||||
sha256: 100c78b08a0f4fc5a5a65797e1498ff5fd6fc9daf96b0898d2de731c35fa4e3e
|
||||
uri: huggingface://MaziyarPanahi/MN-Tiramisu-12B-GGUF/MN-Tiramisu-12B.Q5_K_M.gguf
|
||||
- name: mn-charthink-12b-base-q4
|
||||
variants:
|
||||
- model: mn-charthink-12b-base-q6
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
urls:
|
||||
- https://huggingface.co/SvalTek/MN-CharThink-12B-Base
|
||||
- https://huggingface.co/SvalTek/MN-CharThink-12B-Base-GGUF
|
||||
description: >-
|
||||
MN-CharThink is a 12B Mistral fine-tune for character roleplay. Its think blocks represent
|
||||
in-character thoughts, memories, and emotional responses. This entry uses the Q4_K_M GGUF
|
||||
quantization.
|
||||
license: apache-2.0
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- cpu
|
||||
- gpu
|
||||
- chat
|
||||
- mistral
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 32768
|
||||
known_usecases:
|
||||
- chat
|
||||
options:
|
||||
- use_jinja:true
|
||||
parameters:
|
||||
model: llama-cpp/models/mn-charthink-12b-base/MN-CharThink-12B-Base.Q4_K_M.gguf
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
files:
|
||||
- filename: llama-cpp/models/mn-charthink-12b-base/MN-CharThink-12B-Base.Q4_K_M.gguf
|
||||
sha256: 86a43ec1e00d08af1300f9956440b63bb27b0a2433e56429f41ee98c3d443ea1
|
||||
uri: >-
|
||||
https://huggingface.co/SvalTek/MN-CharThink-12B-Base-GGUF/resolve/b28bcc80c4efa55013b038584505ac869a5cea0d/MN-CharThink-12B-Base.Q4_K_M.gguf
|
||||
- name: mn-charthink-12b-base-q6
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
urls:
|
||||
- https://huggingface.co/SvalTek/MN-CharThink-12B-Base
|
||||
- https://huggingface.co/SvalTek/MN-CharThink-12B-Base-GGUF
|
||||
description: >-
|
||||
MN-CharThink is a 12B Mistral fine-tune for character roleplay. Its think blocks represent
|
||||
in-character thoughts, memories, and emotional responses. This entry uses the Q6_K GGUF
|
||||
quantization.
|
||||
license: apache-2.0
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- cpu
|
||||
- gpu
|
||||
- chat
|
||||
- mistral
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 32768
|
||||
known_usecases:
|
||||
- chat
|
||||
options:
|
||||
- use_jinja:true
|
||||
parameters:
|
||||
model: llama-cpp/models/mn-charthink-12b-base/MN-CharThink-12B-Base.Q6_K.gguf
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
files:
|
||||
- filename: llama-cpp/models/mn-charthink-12b-base/MN-CharThink-12B-Base.Q6_K.gguf
|
||||
sha256: caddabf35479ab5e492649ff98a3474b9bf9cedbc5125a1f14c2c300bed58aff
|
||||
uri: >-
|
||||
https://huggingface.co/SvalTek/MN-CharThink-12B-Base-GGUF/resolve/b28bcc80c4efa55013b038584505ac869a5cea0d/MN-CharThink-12B-Base.Q6_K.gguf
|
||||
- name: mistral-nemo-prism-12b
|
||||
url: github:mudler/LocalAI/gallery/chatml.yaml@master
|
||||
urls:
|
||||
|
||||
Reference in new issue
Block a user