mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 09:08:54 -04:00
feat(gallery): add LFM2.5 24B variants (#12673)
Add official Q4, Q5, Q6, and Q8 GGUF builds with pinned downloads. Document installation and automatic variant selection. Assisted-by: Codex:gpt-6 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
This commit is contained in:
1 parent
39b3b31153
commit
eec2ec33de
2 files changed
+183
No files matched your search
@@ -158,6 +158,25 @@ frees. Removal then waits 30 seconds, during which you can undo it; the delete
|
||||
request is sent only when that time ends. If you leave the page during the wait,
|
||||
nothing is deleted.
|
||||
|
||||
## LFM2.5-24B-A2B
|
||||
|
||||
[LiquidAI LFM2.5-24B-A2B](https://huggingface.co/LiquidAI/LFM2.5-24B-A2B)
|
||||
is a text-only reasoning model with 24B total parameters and 2.45B active
|
||||
parameters. The gallery provides the official Q4_K_M, Q5_K_M, Q6_K, and Q8_0
|
||||
GGUF builds through the `llama-cpp` backend.
|
||||
|
||||
Install the model with automatic variant selection:
|
||||
|
||||
```bash
|
||||
local-ai models install lfm2.5-24b-a2b
|
||||
```
|
||||
|
||||
To select a specific quantization, use `--variant` with `lfm2.5-24b-a2b`
|
||||
(Q4_K_M), `lfm2.5-24b-a2b-q5`, `lfm2.5-24b-a2b-q6`, or
|
||||
`lfm2.5-24b-a2b-q8`. The entries use the embedded tokenizer template, a
|
||||
131,072-token context, and LiquidAI's recommended sampling settings.
|
||||
The weights use the [Liquid AI LFM Open License](https://huggingface.co/LiquidAI/LFM2.5-24B-A2B/blob/main/LICENSE).
|
||||
|
||||
## Cyber-Ornith 1.5 9B
|
||||
|
||||
Cyber-Ornith 1.5 is a Qwen3.5 fine-tune for security auditing, terminal tasks, and tool use.
|
||||
|
||||
Reference in new issue
Block a user