Ettore Di Giacinto 975ff5ca42 feat(gallery): add kev-0.8b-vllm-cpp decision model ...

Add the kev 0.8B decision model, converted for vllm.cpp and pinned to
revision c17e7366 of mudler/kev-0.8b-vllm-cpp. It is a redistribution of
jaredpalmer/kev-0.8b with the LoRA merged and the PointerHead stored as
head.safetensors, so only the vllm-cpp backend can load it.

The artifact sits under overrides, where the installer reads it. The
entry sets a 2048-token context and an explicit KV pool: with the
default 4096-token context the CPU KV pool holds only 4064 tokens and the
load fails.

List the entry in the decisions gallery table and drop kev from the
list of decision models that are not gallery entries yet.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude Code:claude-sonnet-5-5

2026-09-30 22:28:13 +00:00

..

alpaca.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

arch-function.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

audioldm2.yaml

feat(diffusers): add AudioLDM2 generation

2026-09-11 21:53:37 +00:00

bge-m3-colbert.yaml

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

cajal.yaml

feat: add CAJAL gallery model (#9879)

2026-07-30 09:57:31 +02:00

ced.yaml

feat(ced): sound-event classification backend (CED audio tagger) (#10425)

2026-06-22 01:00:28 +02:00

cerbero.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

chatml-hercules.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

chatml.yaml

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

codellama.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

command-r.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

deephermes.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

deepseek-r1.yaml

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

deepseek.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

dreamshaper.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

falcon3.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

flux-ggml.yaml

fix(flux): Set CFG=1 so that prompts are followed (#5378)

2025-05-16 17:53:54 +02:00

flux.yaml

fix(flux): Set CFG=1 so that prompts are followed (#5378)

2025-05-16 17:53:54 +02:00

gemma.yaml

fix(gallery): use tokenizer templates for Gemma

2026-09-11 22:44:39 +00:00

granite3-2.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

granite4.yaml

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

granite.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

harmony.yaml

fix (gallery): Parse harmony output of gpt-oss-* models correctly (#8037) (#11518)

2026-08-14 15:04:12 +02:00

hermes-2-pro-mistral.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

hermes-vllm.yaml

chore(model-gallery): add more quants for popular models (#3365)

2024-08-24 00:29:24 +02:00

index.yaml

feat(gallery): add kev-0.8b-vllm-cpp decision model

2026-09-30 22:28:13 +00:00

jamba.yaml

chore(model gallery): add ai21labs_ai21-jamba-reasoning-3b (#6417)

2025-10-09 15:00:56 +02:00

kimodocpp.yaml

feat: Add kimodo.cpp and 3D animation API/UI (#12095)

2026-09-18 06:12:03 +01:00

kokoros.yaml

feat: Add Kokoros backend (#9212)

2026-04-08 19:23:16 +02:00

lfm.yaml

feat(realtime): Add Liquid Audio s2s model and assistant mode on talk page (#9801)

2026-05-13 21:57:27 +02:00

liquid-audio.yaml

feat: materialize Hugging Face model artifacts (#10825)

2026-07-15 01:09:33 +02:00

llama3-instruct.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

llama3.1-instruct-grammar.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

llama3.1-instruct.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

llama3.1-reflective.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

llama3.2-fcall.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

llama3.2-quantized.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

llava.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

ltx-ggml.yaml

feat(stablediffusion-ggml): LTX-2 support + LTX-2.3 GGUF gallery entries (#9980)

2026-05-25 13:00:28 +02:00

mathstral.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

mistral-0.3.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

moondream.yaml

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

mudler.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

nanbeige4.1.yaml

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

nanbeige4.2.yaml

gallery: add Nanbeige4.2 3B GGUF variants (#11170)

2026-07-30 11:07:32 +02:00

noromaid.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

openvino.yaml

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

parler-tts.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

phi-2-chat.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

phi-2-orange.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

phi-3-chat.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

phi-3-vision.yaml

fix(phi3-vision): add multimodal template (#3944)

2024-10-23 15:34:45 +02:00

phi-4-chat-fcall.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

phi-4-chat.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

piper.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

pocket-tts.yaml

[voice] feat: add managed voice cloning profiles (#10799)

2026-07-13 09:54:46 +02:00

qwen3-deepresearch.yaml

chore(model gallery): add alibaba-nlp_tongyi-deepresearch-30b-a3b (#6295)

2025-09-17 09:22:19 +02:00

qwen3-openbuddy.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

qwen3.yaml

fix: tool-call JSON leaks into content with stream+tools on tokenizer-template models (#10052) (#10057)

2026-05-29 10:12:53 +02:00

qwen-fcall.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

qwen-image.yaml

Update qwen-image.yaml

2025-08-06 10:40:46 +02:00

rerankers.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

rwkv.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

sd-ggml.yaml

chore(model gallery): add sd-3.5-large-ggml (#4647)

2025-01-20 19:04:23 +01:00

sentencetransformers.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

sglang-gemma-4-e2b-mtp.yaml

feat(sglang): wire engine_args, add cuda13 build, ship MTP gallery demos (#9686)

2026-05-07 17:27:29 +02:00

sglang-gemma-4-e4b-mtp.yaml

feat(sglang): wire engine_args, add cuda13 build, ship MTP gallery demos (#9686)

2026-05-07 17:27:29 +02:00

sglang-mimo-7b-mtp.yaml

feat(sglang): wire engine_args, add cuda13 build, ship MTP gallery demos (#9686)

2026-05-07 17:27:29 +02:00

sglang.yaml

feat(sglang): wire engine_args, add cuda13 build, ship MTP gallery demos (#9686)

2026-05-07 17:27:29 +02:00

sherpa-onnx-asr.yaml

feat: Add Sherpa ONNX backend for ASR and TTS (#8523)

2026-04-24 14:40:06 +02:00

sherpa-onnx-tts.yaml

fix(distributed): stage backend companion assets to remote nodes (#10330)

2026-06-14 16:42:59 +02:00

sherpa-onnx-vad.yaml

feat(classifier/VAD): support voice control on low power devices (#10804)

2026-07-29 12:50:22 +02:00

smolvlm.yaml

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

stablediffusion3.yaml

feat(sd-3): add stablediffusion 3 support (#2591)

2024-06-18 15:09:39 +02:00

supertonic.yaml

feat(supertonic): add Supertonic ONNX TTS backend (CPU) (#10342)

2026-06-15 16:54:11 +02:00

trellis2cpp.yaml

feat: Add 3d generation UI/API and trellis2cpp backend (#10979)

2026-07-29 16:15:04 +02:00

tuluv2.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

variant-exclusions.yaml

ci(gallery): propose variant groupings for review instead of letting them decay (#10992)

2026-07-20 23:08:00 +02:00

vibevoice.yaml

feat(vibevoice): add new backend (#7494)

2025-12-10 21:14:21 +01:00

vicuna-chat.yaml

models(gallery): add apollo2-9b (#3860)

2024-10-17 10:16:52 +02:00

virtual.yaml

fix: yamlint warnings and errors (#2131)

2024-04-25 17:25:56 +00:00

vllm.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

wan-ggml.yaml

Fix use case for video model (#11214)

2026-07-30 08:57:09 +02:00

whisper-base.yaml

models(gallery): add all whisper variants (#2462)

2024-06-01 20:04:03 +02:00

wizardlm2.yaml

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

z-image-ggml.yaml

Fix load of z-image-turbo (#9264)

2026-04-11 08:42:13 +02:00