Tai An 688f904a10 fix(runtime-settings): apply persisted threads/context_size/f16 at startup (#10853) ...

ApplyRuntimeSettings persists the performance settings (threads,
context_size, f16) on the live /api/settings path, but the startup
loader loadRuntimeSettingsFromFile never read them back, so a value
saved via the Middleware UI was silently ignored on the next restart:
the model booted with the CLI/physical-core default and GET /api/settings
echoed that default instead of the saved value (#10845).

Threads needs special handling: unlike context_size/f16, WithThreads
eagerly resolves an unset (0) value to xsysinfo.CPUPhysicalCores() at
option-apply time, so options.Threads is never 0 in the loader and the
usual "== default" heuristic cannot tell an env/CLI value from the
physical-core fallback. Detect LOCALAI_THREADS/THREADS explicitly so the
env still wins over the persisted file value.

Signed-off-by: Anai-Guo <Anai-Guo@users.noreply.github.com>
Co-authored-by: Anai-Guo <Anai-Guo@users.noreply.github.com>

2026-07-16 08:52:11 +02:00

..

agent_jobs.go

feat(distributed): SyncedMap component + migrate finetune/quant/agent-tasks to cross-replica state (#10542)

2026-06-27 23:23:51 +02:00

application_suite_test.go

feat(branding): admin-configurable instance name, tagline, and assets (#9635)

2026-05-02 15:51:36 +02:00

application.go

feat: materialize Hugging Face model artifacts (#10825)

2026-07-15 01:09:33 +02:00

config_file_watcher.go

fix(watchdog): persist UI-saved Check Interval across restarts (#10601) (#10605)

2026-06-30 17:48:14 +02:00

distributed.go

fix(distributed): don't let a dead worker pin the model-load advisory lock (#10600)

2026-07-02 09:52:51 +02:00

mitm_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

mitm.go

feat(pii): NER tier engine — privacy-filter.cpp backend + NER-centric PII filter (#10360)

2026-06-18 11:45:22 +01:00

model_artifact_materializer_test.go

feat: materialize Hugging Face model artifacts (#10825)

2026-07-15 01:09:33 +02:00

p2p.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

pii_policy_test.go

feat(pii): NER tier engine — privacy-filter.cpp backend + NER-centric PII filter (#10360)

2026-06-18 11:45:22 +01:00

router_factories_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

router_factories.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

runtime_settings_branding_test.go

fix(logs): capture backend logs by default in single mode (#10742)

2026-07-08 12:13:52 +00:00

startup.go

fix(runtime-settings): apply persisted threads/context_size/f16 at startup (#10853)

2026-07-16 08:52:11 +02:00

upgrade_checker.go

fix(distributed): make per-node backend upgrade actually upgrade (#10838)

2026-07-15 09:16:55 +02:00

watchdog_test.go

feat(concurrency-groups): per-model exclusive groups for backend loading (#9662)

2026-05-05 08:42:50 +02:00

watchdog.go

feat(watchdog): add size-aware LRU eviction mode (#9527)

2026-06-21 17:17:04 +02:00