LocalAI

mirror/LocalAI

0 Fork 0

mirror of https://github.com/mudler/LocalAI.git synced 2026-09-28 09:05:05 -04:00

Files

T

History

f82efdb43b fix(models): fallback to application config default context size in /v1/models/capabilities (#12202 ) (#12216 )

* fix(models): fallback to application config default context size (#12202)

Honor appConfig.ContextSize in /v1/models/capabilities when model context_size is unset.

* docs(models): explain context size fallback

Describe the application default used by capability discovery and
preserve the distinction between total context and per-request limits.

Assisted-by: Codex:GPT-6

* fix(models): apply the default context size only when context_size is unset

The request path applies the application default context size only
when a model leaves context_size unset. An explicit 0 or -1 falls
through to the backend fallback. The capabilities endpoint now does
the same, so it reports the value the backend uses.

Assisted-by: Claude:claude-opus-5-5 [Claude Code]
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>

2026-09-28 00:52:56 +02:00

advanced

Merge PR #11546 : docs: replace dead chatbot-ui example link with repo root

2026-09-27 19:49:35 +00:00

features

fix(models): fallback to application config default context size in /v1/models/capabilities (#12202 ) (#12216 )

2026-09-28 00:52:56 +02:00

getting-started

fix(ollama): report on-disk size for /api/tags and /api/ps (#11989 )

2026-09-28 00:11:41 +02:00

operations

[router] fix: re-seed the knn corpus index when the vector store comes back empty (#12267 )