Ettore Di Giacinto acf4f5add3 feat(backend): forward resolved chat_template_kwargs blob to backends ...

gRPCPredictOpts now merges per-request client metadata over the server-derived
enable_thinking/reasoning_effort (reaching all backends via the standalone keys)
and serialises the resolved chat_template_kwargs map into a JSON blob for
llama.cpp, written last so a client cannot clobber it. Issue #10329.

Assisted-by: Claude:claude-opus-4-8
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-16 07:54:48 +00:00

..

application

feat(distributed): declarative per-model scheduling via env/args (#10308)

2026-06-13 18:31:06 +02:00

backend

feat(backend): forward resolved chat_template_kwargs blob to backends

2026-06-16 07:54:48 +00:00

cli

feat(distributed): declarative per-model scheduling via env/args (#10308)

2026-06-13 18:31:06 +02:00

clients

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

config

feat(config): add chat_template_kwargs model field + resolver

2026-06-16 07:49:13 +00:00

dependencies_manager

feat(ui): move to React for frontend (#8772)

2026-03-05 21:47:12 +01:00

explorer

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

gallery

feat(omnivoice-cpp): add OmniVoice TTS backend (file + streaming, voice cloning + voice design) (#10310)

2026-06-13 21:28:46 +02:00

http

feat(react-ui): localize models and fix 'Import' typo (#10341)

2026-06-15 18:26:27 +02:00

p2p

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

schema

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

services

fix(distributed): stage backend companion assets to remote nodes (#10330)

2026-06-14 16:42:59 +02:00

startup

feat(gallery): verify backend OCI images with keyless cosign (#9823)

2026-05-18 08:02:20 +02:00

templates

fix(openresponses): populate Content and accept bare {role,content} items (#10039) (#10040)

2026-05-28 07:21:48 +00:00

trace

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00