mirror of
https://github.com/mudler/LocalAI.git
synced 2026-11-06 04:23:15 -05:00
feat(gallery): add Nanbeige4.3 GGUF variants
Add AD-Q4_K_M and Q8_0 builds with pinned URLs and verified checksums. Group the builds and document installation with a 32K default context. Assisted-by: Codex:gpt-6
This commit is contained in:
1 parent
fd1a158814
commit
1f41de1611
3 files changed
+164
No files matched your search
@@ -191,6 +191,22 @@ frees. Removal then waits 30 seconds, during which you can undo it; the delete
|
||||
request is sent only when that time ends. If you leave the page during the wait,
|
||||
nothing is deleted.
|
||||
|
||||
## Nanbeige4.3-33B
|
||||
|
||||
[Nanbeige4.3-33B](https://huggingface.co/Nanbeige/Nanbeige4.3-33B) is a text model for reasoning, coding, and agent tasks. The gallery offers AtomicChat AD-Q4_K_M and Q8_0 GGUF builds for `llama-cpp`. Both use the embedded chat template with thinking enabled and a default context of 32,768 tokens.
|
||||
|
||||
Install the grouped entry to let LocalAI select a build that fits the host:
|
||||
|
||||
```bash
|
||||
local-ai models install nanbeige4.3-33b-ad-q4
|
||||
```
|
||||
|
||||
To select Q8_0 explicitly:
|
||||
|
||||
```bash
|
||||
local-ai models install nanbeige4.3-33b-q8
|
||||
```
|
||||
|
||||
## LFM2.5-24B-A2B
|
||||
|
||||
[LiquidAI LFM2.5-24B-A2B](https://huggingface.co/LiquidAI/LFM2.5-24B-A2B)
|
||||
|
||||
@@ -23663,6 +23663,72 @@
|
||||
model: llama-cpp/models/Qwen_Qwen3-Next-80B-A3B-Thinking-Q4_K_M.gguf
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
- url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
name: nanbeige4.3-33b-ad-q4
|
||||
description: |
|
||||
Nanbeige4.3-33B is a 33B dense model for reasoning, coding, and
|
||||
agent tasks in English and Chinese. This AD-Q4_K_M GGUF build
|
||||
uses llama.cpp with the embedded chat template and thinking enabled.
|
||||
license: apache-2.0
|
||||
urls:
|
||||
- https://huggingface.co/Nanbeige/Nanbeige4.3-33B
|
||||
- https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- reasoning
|
||||
- coding
|
||||
- cpu
|
||||
- gpu
|
||||
files:
|
||||
- filename: Nanbeige4.3-33B-AD-Q4_K_M.gguf
|
||||
sha256: 409c92c4355c81928f0f2de5d49481fe7e4d0fa4d381aa28eddee0dc4b358c49
|
||||
uri: https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF/resolve/b39515bab760dc8d6f7da7b4073847997971e2b7/Nanbeige4.3-33B-AD-Q4_K_M.gguf
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 32768
|
||||
options:
|
||||
- use_jinja:true
|
||||
parameters:
|
||||
model: Nanbeige4.3-33B-AD-Q4_K_M.gguf
|
||||
temperature: 0.6
|
||||
top_p: 0.95
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
variants:
|
||||
- model: nanbeige4.3-33b-q8
|
||||
- url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
name: nanbeige4.3-33b-q8
|
||||
description: |
|
||||
Nanbeige4.3-33B is a 33B dense model for reasoning, coding, and
|
||||
agent tasks in English and Chinese. This Q8_0 GGUF build
|
||||
uses llama.cpp with the embedded chat template and thinking enabled.
|
||||
license: apache-2.0
|
||||
urls:
|
||||
- https://huggingface.co/Nanbeige/Nanbeige4.3-33B
|
||||
- https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- reasoning
|
||||
- coding
|
||||
- cpu
|
||||
- gpu
|
||||
files:
|
||||
- filename: Nanbeige4.3-33B-Q8_0.gguf
|
||||
sha256: 4106cbb9ba85da731f88b7493a90343e0d8cd6c77974ed1af00a97c5262c22bc
|
||||
uri: https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF/resolve/b39515bab760dc8d6f7da7b4073847997971e2b7/Nanbeige4.3-33B-Q8_0.gguf
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 32768
|
||||
options:
|
||||
- use_jinja:true
|
||||
parameters:
|
||||
model: Nanbeige4.3-33B-Q8_0.gguf
|
||||
temperature: 0.6
|
||||
top_p: 0.95
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
- url: github:mudler/LocalAI/gallery/nanbeige4.1.yaml@master
|
||||
name: nanbeige4.1-3b-q8
|
||||
description: |
|
||||
|
||||
@@ -27664,6 +27664,88 @@
|
||||
model: llama-cpp/models/Qwen_Qwen3-Next-80B-A3B-Thinking-Q4_K_M.gguf
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
- kind: model
|
||||
id: nanbeige4.3-33b-ad-q4
|
||||
name: nanbeige4.3-33b-ad-q4
|
||||
version: 0.0.0-gallery.b39515bab760
|
||||
description: |
|
||||
Nanbeige4.3-33B is a 33B dense model for reasoning, coding, and
|
||||
agent tasks in English and Chinese. This AD-Q4_K_M GGUF build
|
||||
uses llama.cpp with the embedded chat template and thinking enabled.
|
||||
license: apache-2.0
|
||||
urls:
|
||||
- https://huggingface.co/Nanbeige/Nanbeige4.3-33B
|
||||
- https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- reasoning
|
||||
- coding
|
||||
- cpu
|
||||
- gpu
|
||||
channel: gallery
|
||||
policy:
|
||||
requireSignature: false
|
||||
schemaVersion: 1
|
||||
model:
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
files:
|
||||
- filename: Nanbeige4.3-33B-AD-Q4_K_M.gguf
|
||||
sha256: 409c92c4355c81928f0f2de5d49481fe7e4d0fa4d381aa28eddee0dc4b358c49
|
||||
uri: https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF/resolve/b39515bab760dc8d6f7da7b4073847997971e2b7/Nanbeige4.3-33B-AD-Q4_K_M.gguf
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 32768
|
||||
options:
|
||||
- use_jinja:true
|
||||
parameters:
|
||||
model: Nanbeige4.3-33B-AD-Q4_K_M.gguf
|
||||
temperature: 0.6
|
||||
top_p: 0.95
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
variants:
|
||||
- model: nanbeige4.3-33b-q8
|
||||
- kind: model
|
||||
id: nanbeige4.3-33b-q8
|
||||
name: nanbeige4.3-33b-q8
|
||||
version: 0.0.0-gallery.b39515bab760
|
||||
description: |
|
||||
Nanbeige4.3-33B is a 33B dense model for reasoning, coding, and
|
||||
agent tasks in English and Chinese. This Q8_0 GGUF build
|
||||
uses llama.cpp with the embedded chat template and thinking enabled.
|
||||
license: apache-2.0
|
||||
urls:
|
||||
- https://huggingface.co/Nanbeige/Nanbeige4.3-33B
|
||||
- https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- reasoning
|
||||
- coding
|
||||
- cpu
|
||||
- gpu
|
||||
channel: gallery
|
||||
policy:
|
||||
requireSignature: false
|
||||
schemaVersion: 1
|
||||
model:
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
files:
|
||||
- filename: Nanbeige4.3-33B-Q8_0.gguf
|
||||
sha256: 4106cbb9ba85da731f88b7493a90343e0d8cd6c77974ed1af00a97c5262c22bc
|
||||
uri: https://huggingface.co/AtomicChat/Nanbeige4.3-33B-GGUF/resolve/b39515bab760dc8d6f7da7b4073847997971e2b7/Nanbeige4.3-33B-Q8_0.gguf
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 32768
|
||||
options:
|
||||
- use_jinja:true
|
||||
parameters:
|
||||
model: Nanbeige4.3-33B-Q8_0.gguf
|
||||
temperature: 0.6
|
||||
top_p: 0.95
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
- kind: model
|
||||
id: nanbeige4.1-3b-q8
|
||||
name: nanbeige4.1-3b-q8
|
||||
|
||||
Reference in new issue
Block a user