Ettore Di Giacinto 975ff5ca42 feat(gallery): add kev-0.8b-vllm-cpp decision model ...

Add the kev 0.8B decision model, converted for vllm.cpp and pinned to
revision c17e7366 of mudler/kev-0.8b-vllm-cpp. It is a redistribution of
jaredpalmer/kev-0.8b with the LoRA merged and the PointerHead stored as
head.safetensors, so only the vllm-cpp backend can load it.

The artifact sits under overrides, where the installer reads it. The
entry sets a 2048-token context and an explicit KV pool: with the
default 4096-token context the CPU KV pool holds only 4064 tokens and the
load fails.

List the entry in the decisions gallery table and drop kev from the
list of decision models that are not gallery entries yet.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude Code:claude-sonnet-5-5

2026-09-30 22:28:13 +00:00

..

advanced

refactor: name the capability decisions instead of systemone

2026-09-30 14:14:09 +00:00

features

feat(gallery): add kev-0.8b-vllm-cpp decision model

2026-09-30 22:28:13 +00:00

getting-started

docs: fix 11 dead links in the documentation (#12320)

2026-09-28 08:33:15 +02:00

operations

Merge PR #12285: feat(failover): serve a model name from a chain of local and remote targets

2026-09-28 15:32:30 +00:00

reference

docs: fix 11 dead links in the documentation (#12320)

2026-09-28 08:33:15 +02:00

_index.md

feat(website): split the site, move docs to /docs, add a landing page (#11243)

2026-07-31 09:00:56 +02:00

faq.md

docs(faq): note OPENAI_BASE_URL env var for pointing clients at LocalAI (#11310)

2026-09-11 14:44:18 +02:00

integrations.md

docs: fix 11 dead links in the documentation (#12320)

2026-09-28 08:33:15 +02:00

overview.md

feat(website): split the site, move docs to /docs, add a landing page (#11243)

2026-07-31 09:00:56 +02:00

whats-new.md

docs: point the News page at the blog instead of a stale highlights list

2026-08-03 20:29:50 +00:00