feat(gallery): add Humanizer 12B BF16 variant

Offer the unquantized GGUF alongside the existing Humanizer builds.
Document variant selection and the required completion prompt.

Assisted-by: Codex:gpt-6

(cherry picked from commit 3fc4ea5eca, mudler/LocalAI#12803)
Assisted-by: Claude:claude-sonnet-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
localai-org-maint-bot authored and Ettore Di Giacinto committed 2026-10-25 09:55:39 +00:00
1 parent a0b4af9369
commit 89d4b66069
2 files changed
+94

No files matched your search

+43
View File
@@ -3,6 +3,48 @@
# written by scripts/models/cmd/modelcatalog and stays only so releases before
# the cutover keep working. CI fails when it differs from the generated copy:
# go run ./scripts/models/cmd/modelcatalog --library gallery/models/index.yaml --out gallery/index.yaml
- url: github:mudler/LocalAI/gallery/virtual.yaml@master
name: humanizer-12b-bf16
description: |
Humanizer is a 12B Gemma 4 fine-tune for rewriting English and Chinese text.
This unquantized BF16 GGUF build uses llama.cpp with an 8,192-token context.
This entry uses the completions API with the publisher's exact rewriting prompt.
license: apache-2.0
urls:
- https://huggingface.co/google/gemma-4-12B
- https://huggingface.co/jialinyyzz/humanizer
tags:
- llm
- gguf
- cpu
- gpu
- text-generation
- rewriting
- gemma
files:
- filename: humanizer-12b-bf16.gguf
sha256: 47d79b44c3e15ea2540f4edb63556f2b7e456067d7dd252a42ff103a26a51be9
uri: https://huggingface.co/jialinyyzz/humanizer/resolve/2e57b6528a4070c33f3e09ca24e3325a84272f68/humanizer-12b-bf16.gguf
overrides:
backend: llama-cpp
context_size: 8192
known_input_modalities:
- text
known_usecases:
- completion
mmap: true
options:
- use_jinja:false
parameters:
min_p: 0
model: humanizer-12b-bf16.gguf
repeat_penalty: 1.0
temperature: 1.0
top_k: 0
top_p: 0.95
stopwords: []
template:
completion: '{{.Input}}'
- url: github:mudler/LocalAI/gallery/virtual.yaml@master
name: lfm2.5-24b-a2b-ud-q4
description: |
@@ -77663,6 +77705,7 @@
- model: humanizer-12b-q3-qat
- model: humanizer-12b-q6
- model: humanizer-12b-q8
- model: humanizer-12b-bf16
- url: github:mudler/LocalAI/gallery/virtual.yaml@master
name: humanizer-12b-q6
description: |
+51
View File
@@ -4,6 +4,56 @@
# changes and never edit it by hand. CI fails when it is stale. A build from
# master reads it as the default model source; a tagged build reads the gallery
# until the release cutover.
- kind: model
id: humanizer-12b-bf16
name: humanizer-12b-bf16
version: 0.0.0-gallery.5a9c8fba6573
description: |
Humanizer is a 12B Gemma 4 fine-tune for rewriting English and Chinese text.
This unquantized BF16 GGUF build uses llama.cpp with an 8,192-token context.
This entry uses the completions API with the publisher's exact rewriting prompt.
license: apache-2.0
urls:
- https://huggingface.co/google/gemma-4-12B
- https://huggingface.co/jialinyyzz/humanizer
tags:
- llm
- gguf
- cpu
- gpu
- text-generation
- rewriting
- gemma
channel: gallery
policy:
requireSignature: false
schemaVersion: 1
model:
url: github:mudler/LocalAI/gallery/virtual.yaml@master
files:
- filename: humanizer-12b-bf16.gguf
sha256: 47d79b44c3e15ea2540f4edb63556f2b7e456067d7dd252a42ff103a26a51be9
uri: https://huggingface.co/jialinyyzz/humanizer/resolve/2e57b6528a4070c33f3e09ca24e3325a84272f68/humanizer-12b-bf16.gguf
overrides:
backend: llama-cpp
context_size: 8192
known_input_modalities:
- text
known_usecases:
- completion
mmap: true
options:
- use_jinja:false
parameters:
min_p: 0
model: humanizer-12b-bf16.gguf
repeat_penalty: 1.0
temperature: 1.0
top_k: 0
top_p: 0.95
stopwords: []
template:
completion: '{{.Input}}'
- kind: model
id: lfm2.5-24b-a2b-ud-q4
name: lfm2.5-24b-a2b-ud-q4
@@ -95452,6 +95502,7 @@
- model: humanizer-12b-q3-qat
- model: humanizer-12b-q6
- model: humanizer-12b-q8
- model: humanizer-12b-bf16
- kind: model
id: humanizer-12b-q6
name: humanizer-12b-q6