LocalAI [bot] 5569b2de56 feat(config): context_size: -1 to auto-use model's full trained context (#10752) ...

* feat(config): clamp negative context_size to default in EffectiveContextSize

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-8 [Claude Code]

* feat(config): resolve context_size=-1 to model trained max with VRAM warn

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-8 [Claude Code]

* fix(config): treat negative context_size as unset when GGUF is unparseable

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-8 [Claude Code]

* docs(config): document context_size=-1 auto-max

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-8 [Claude Code]

* docs(backend): drop em dashes from EffectiveContextSize comment

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-8 [Claude Code]

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>

2026-07-09 09:03:40 +02:00

..

audio_transform.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

backend_suite_test.go

feat: extract output with regexes from LLMs (#3491)

2024-09-13 13:27:36 +02:00

ctx_propagation_test.go

feat(tts): support per-request instructions and params (#10172)

2026-06-04 11:45:02 +02:00

depth.go

feat(backend): add depth-anything (Depth Anything 3) C++/ggml backend + gallery (#10352)

2026-06-16 16:28:28 +02:00

detection.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

diarization_test.go

feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp (#9654)

2026-05-05 15:10:13 +02:00

diarization.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

embeddings.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

face_analyze.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

face_embed.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

face_verify.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

image.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

llm_probe_test.go

fix(reasoning): don't persist request-scoped reasoning_effort as an operator disable (#10622) (#10623)

2026-07-06 09:23:10 +02:00

llm_test.go

feat(autoparser): prefer chat deltas from backends when emitted (#9224)

2026-04-04 12:12:08 +02:00

llm.go

fix(reasoning): don't persist request-scoped reasoning_effort as an operator disable (#10622) (#10623)

2026-07-06 09:23:10 +02:00

model_load_trace_test.go

feat(realtime): Semantic VAD EOU token (#10444)

2026-06-30 09:01:22 +02:00

options_internal_test.go

feat(config): context_size: -1 to auto-use model's full trained context (#10752)

2026-07-09 09:03:40 +02:00

options.go

feat(config): context_size: -1 to auto-use model's full trained context (#10752)

2026-07-09 09:03:40 +02:00

prefix_source_internal_test.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

prefix_source.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

preload_internal_test.go

feat(realtime): eager blocking pipeline warm-up + /backend/load API (#10662)

2026-07-03 18:00:37 +02:00

preload.go

feat(realtime): eager blocking pipeline warm-up + /backend/load API (#10662)

2026-07-03 18:00:37 +02:00

rerank.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

score_test.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

score.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

sound_classification.go

feat(ced): sound-event classification backend (CED audio tagger) (#10425)

2026-06-22 01:00:28 +02:00

soundgeneration.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

stores_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

stores.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

token_classify_test.go

feat(pii): NER tier engine — privacy-filter.cpp backend + NER-centric PII filter (#10360)

2026-06-18 11:45:22 +01:00

token_classify.go

feat(pii): NER tier engine — privacy-filter.cpp backend + NER-centric PII filter (#10360)

2026-06-18 11:45:22 +01:00

token_metrics.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

tokenize_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

tokenize.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

transcript_live_internal_test.go

feat(realtime): Semantic VAD EOU token (#10444)

2026-06-30 09:01:22 +02:00

transcript_live.go

feat(realtime): Semantic VAD EOU token (#10444)

2026-06-30 09:01:22 +02:00

transcript.go

feat(realtime): Semantic VAD EOU token (#10444)

2026-06-30 09:01:22 +02:00

tts_test.go

feat(tts): support per-request instructions and params (#10172)

2026-06-04 11:45:02 +02:00

tts.go

feat(tts): support per-request instructions and params (#10172)

2026-06-04 11:45:02 +02:00

vad.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

video.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

voice_analyze.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

voice_embed.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

voice_verify.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00