Files
LocalAI/core/schema
localai-org-maint-botandEttore Di Giacinto 2d30d28f32 feat: expose context_size in /v1/models/capabilities (#12083)
* fix(ui): restore node operation controls

The node restructure hid backend logs and split related controls
across inconsistent layouts.

Restore contextual log actions and align the detail page with the
fleet dashboard. Make multi-node selection clear and accessible.

Assisted-by: Codex:gpt-5 Playwright ESLint

* feat: expose context_size in /v1/models/capabilities

The /v1/models/capabilities endpoint already enriches the OpenAI models
listing with capabilities and modalities. Add context_size to that
enrichment so clients (e.g. nib) can size their context budget for
auto-compaction and pruning without guessing.

The value comes from backend.EffectiveContextSize, which resolves the
configured context_size or falls back to DefaultContextSize (4096) —
the same number the backend itself runs with. It is omitempty so a
loose file with no config surfaces 0 (unknown) rather than a misleading
default, and existing clients that don't know the field see no change.

---------

Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
2026-09-16 14:40:35 +00:00
..
2025-06-15 14:56:52 +02:00
2026-03-30 00:47:27 +02:00