mirror of
https://github.com/mudler/LocalAI.git
synced 2026-08-04 12:22:22 -04:00
d6d9f899d6
* gallery: add Nanbeige4.2 3B GGUF variants Add Q4_K_M and Q8_0 builds of the compact Nanbeige4.2 agentic and reasoning model, grouped as install-time variants. Assisted-by: Codex:gpt-5 * gallery: simplify Nanbeige4.2 model name Apply the maintainer-requested canonical model name while retaining the quantization variants under the entry.\n\nAssisted-by: Codex:gpt-5 --------- Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
16 lines
305 B
YAML
16 lines
305 B
YAML
config_file: |
|
|
backend: llama-cpp
|
|
function:
|
|
grammar:
|
|
disable: true
|
|
known_usecases:
|
|
- chat
|
|
- completion
|
|
options:
|
|
- use_jinja:true
|
|
parameters:
|
|
model: llama-cpp/models/nanbeige4.2-3b-q8_0.gguf
|
|
template:
|
|
use_tokenizer_template: true
|
|
name: nanbeige4.2
|