LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2026-06-25 00:59:28 -04:00

Files

Ettore Di Giacinto 28beac9a18 fix(llama-cpp): terminate tensor/kv override vectors after passthrough

The tensor_buft_overrides padding and the kv/draft override terminators
ran before the generic option passthrough, so a passthrough flag
(--cpu-moe, --override-tensor, --override-kv, ...) appended a real entry
after the null sentinel - tripping the model loader's
back().pattern == nullptr assertion (crash) or being silently dropped.
Move all three termination/padding blocks to the end of params_parse,
after both the named-option loop and common_params_parse have pushed
their real entries. Also widen the exit()-flag skip list so --version,
--license, --list-devices and --cache-list cannot terminate the backend.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-24 17:28:22 +00:00

advanced

fix(llama-cpp): terminate tensor/kv override vectors after passthrough

2026-06-24 17:28:22 +00:00

features

fix(pii): load default detectors at startup + add LOCALAI_PII_DEFAULT_DETECTORS (#10474 )

2026-06-24 11:08:57 +02:00

getting-started

feat: send a LocalAI User-Agent on registry pulls (#10434 )

2026-06-22 08:44:12 +02:00

installation

feat(ui): Interactive model config editor with autocomplete (#9149 )