Ettore Di Giacinto acf4f5add3 feat(backend): forward resolved chat_template_kwargs blob to backends ...

gRPCPredictOpts now merges per-request client metadata over the server-derived
enable_thinking/reasoning_effort (reaching all backends via the standalone keys)
and serialises the resolved chat_template_kwargs map into a JSON blob for
llama.cpp, written last so a client cannot clobber it. Issue #10329.

Assisted-by: Claude:claude-opus-4-8
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-16 07:54:48 +00:00

..

audio_transform.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

backend_suite_test.go

feat: extract output with regexes from LLMs (#3491)

2024-09-13 13:27:36 +02:00

ctx_propagation_test.go

feat(tts): support per-request instructions and params (#10172)

2026-06-04 11:45:02 +02:00

detection.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

diarization_test.go

feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp (#9654)

2026-05-05 15:10:13 +02:00

diarization.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

embeddings.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

face_analyze.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

face_embed.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

face_verify.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

image.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

llm_probe_test.go

Respect explicit reasoning config during GGUF thinking probe (#9463)

2026-04-21 21:53:10 +02:00

llm_test.go

feat(autoparser): prefer chat deltas from backends when emitted (#9224)

2026-04-04 12:12:08 +02:00

llm.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

options_internal_test.go

feat(backend): forward resolved chat_template_kwargs blob to backends

2026-06-16 07:54:48 +00:00

options.go

feat(backend): forward resolved chat_template_kwargs blob to backends

2026-06-16 07:54:48 +00:00

prefix_source_internal_test.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

prefix_source.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

rerank.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

score_test.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

score.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

soundgeneration.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

stores_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

stores.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

token_metrics.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

tokenize_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

tokenize.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

transcript.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

tts_test.go

feat(tts): support per-request instructions and params (#10172)

2026-06-04 11:45:02 +02:00

tts.go

feat(tts): support per-request instructions and params (#10172)

2026-06-04 11:45:02 +02:00

vad.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

video.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

voice_analyze.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

voice_embed.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00

voice_verify.go

fix(traces): cap backend trace Data to keep admin UI responsive (#9960)

2026-05-23 14:50:40 +02:00