LocalAI

0 Fork 0

mirror of https://github.com/mudler/LocalAI.git synced 2026-09-12 22:33:54 -04:00

Files

T

Ettore Di Giacinto 04735cd1f6 fix(distributed): stamp config revision at load time

The request middleware merges the caller's prediction parameters into
its copy of the model config. core/backend.ModelOptions then hashed
that copy, so the revision identified the request body rather than the
persisted configuration.

EstablishModelConfigRevision stores the first revision it sees and
requires an exact match afterwards. The first request after a restart
therefore pinned the model to its own temperature, top_p and stop
values, and every later request that sent different ones failed with
"stale model config revision". No config edit was involved.

The loader now stamps the revision when it materializes a config,
before any request override reaches it, and ModelOptions reads that
stamp. Model administration keeps hashing the same persisted config, so
both paths agree on one revision per configuration.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude Code:claude-opus-5 [golangci-lint]

2026-08-23 14:35:44 +00:00

advanced

fix(vram): persist remote probe metadata (#11487 )

2026-08-23 08:55:13 +02:00

features

fix(distributed): stamp config revision at load time

2026-08-23 14:35:44 +00:00

getting-started

docs(website): simplify installation paths (#11631 )

2026-08-21 21:20:54 +02:00

operations

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652 )