mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 17:18:49 -04:00
feat(gallery): add Humanizer 12B BF16 variant
Offer the unquantized GGUF alongside the existing Humanizer builds. Document variant selection and the required completion prompt. Assisted-by: Codex:gpt-6
This commit is contained in:
1 parent
7d528e90f4
commit
3fc4ea5eca
3 files changed
+116
No files matched your search
@@ -44,6 +44,28 @@ Both views store the view, search, filter, and selection in the URL. Installing
|
||||
from Explore does not move you away from the catalog; the entry updates in place
|
||||
when the operation finishes.
|
||||
|
||||
### Humanizer 12B
|
||||
|
||||
[Humanizer 12B](https://huggingface.co/jialinyyzz/humanizer) rewrites English and
|
||||
Chinese drafts with the llama.cpp backend. Its variants include quantized GGUF
|
||||
builds and an unquantized BF16 build. Each uses an 8,192-token context.
|
||||
|
||||
To install BF16 explicitly:
|
||||
|
||||
```bash
|
||||
local-ai models install humanizer-12b-q4 --variant humanizer-12b-bf16
|
||||
```
|
||||
|
||||
Omit `--variant` for automatic selection based on available memory. BF16 weights
|
||||
require approximately 23.8 GB of disk space, plus memory for inference.
|
||||
|
||||
These gallery entries use the completions API. Send the publisher's instruction,
|
||||
two newline characters, the trimmed draft, and the separator
|
||||
`\n\n### Rewritten:\n\n` as the prompt. Copy the instruction verbatim from
|
||||
[the publisher's prompt format](https://huggingface.co/jialinyyzz/humanizer/blob/2e57b6528a4070c33f3e09ca24e3325a84272f68/prompt_format.json).
|
||||
Keep the configured sampling settings and do not add stop strings. Split long
|
||||
documents at paragraph boundaries and review rewrites for factual changes.
|
||||
|
||||
### MiniCPM-V 4.7 1B
|
||||
|
||||
[MiniCPM-V 4.7 1B](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B)
|
||||
|
||||
Reference in new issue
Block a user