Ettore Di Giacinto 6df1767133 fix(localai-proxy): keep rerank, stream errors and chat intact through the proxy ...

Rerank no longer sends top_n 0, which the upstream rejects. A
mid-stream upstream error frame now fails the call instead of ending
it as a short success. Temperature 0 is forwarded. An upstream 429
becomes ResourceExhausted, which failover skips like Unimplemented.

A localai-proxy config sends its own name upstream when upstream_model
is unset, and a chat proxy defaults to the tokenizer template so chat
reaches the upstream as messages.

Assisted-by: Claude:claude-opus-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-09-27 07:42:21 +00:00

..

admission_test.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

admission.go

fix(failover): spill capacity and disabled targets without tripping them

2026-09-27 07:42:20 +00:00

baseurl_test.go

fix: correct scheme/host on self-referential URLs behind an HTTPS reverse proxy (#10482) (#10504)

2026-06-25 08:10:59 +02:00

baseurl.go

fix: correct scheme/host on self-referential URLs behind an HTTPS reverse proxy (#10482) (#10504)

2026-06-25 08:10:59 +02:00

compress_test.go

perf(http): gzip responses, cache hashed assets, bound the trace endpoints (#11056)

2026-07-22 22:51:25 +02:00

compress.go

perf(http): gzip responses, cache hashed assets, bound the trace endpoints (#11056)

2026-07-22 22:51:25 +02:00

compression_test.go

feat(chat): add end-to-end context compression (#11556)

2026-08-18 11:31:03 +00:00

compression.go

feat(chat): add end-to-end context compression (#11556)

2026-08-18 11:31:03 +00:00

context_keys.go

fix(failover): spill capacity and disabled targets without tripping them

2026-09-27 07:42:20 +00:00

failover_test.go

fix(localai-proxy): keep rerank, stream errors and chat intact through the proxy

2026-09-27 07:42:21 +00:00

failover.go

feat(grpc): serve Rerank from Go backends and skip Unimplemented targets

2026-09-27 07:42:21 +00:00

forwarded_prefix_test.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

forwarded_prefix.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

middleware_suite_test.go

feat: migrate to echo and enable cancellation of non-streaming requests (#7270)

2025-11-14 22:57:53 +01:00

node_header_concurrency_test.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

node_header_integration_test.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

node_header_test.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

node_header.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

probe_trim_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

request_config_revision_test.go

fix(distributed): hash the config as persisted, not as defaulted

2026-08-24 11:45:32 +00:00

request_test.go

fix(ollama): accept :latest tag on model lookup (#11732)

2026-08-26 08:57:36 +02:00

request.go

fix(failover): spill capacity and disabled targets without tripping them

2026-09-27 07:42:20 +00:00

route_model_test.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

route_model.go

fix(openai): return HTTP errors for pre-stream failures and report per-slot context (#12204)

2026-09-22 17:19:58 +02:00

security_headers_test.go

feat(localvqe/audio): v1.3 release and add spectrograms to audio transform UI (#10113)

2026-05-31 23:56:46 +02:00

security_headers.go

feat(localvqe/audio): v1.3 release and add spectrograms to audio transform UI (#10113)

2026-05-31 23:56:46 +02:00

strippathprefix_test.go

feat: migrate to echo and enable cancellation of non-streaming requests (#7270)

2025-11-14 22:57:53 +01:00

strippathprefix.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

trace_body_cap_test.go

fix(traces): cap captured body size to keep admin Traces UI responsive (#9946)

2026-05-22 15:29:24 +02:00

trace_live_test.go

feat(kimodo): Add observability hooks (#12184)

2026-09-22 07:06:32 +00:00

trace_pagination_test.go

perf(http): gzip responses, cache hashed assets, bound the trace endpoints (#11056)

2026-07-22 22:51:25 +02:00

trace_persistence_test.go

feat(tracing): persist bounded trace histories (#11203)

2026-07-30 12:20:01 +02:00

trace_redact_test.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

trace_summary_test.go

feat(ui): give Operate and Studio a front door, and fix two layout regressions (#11305)

2026-08-03 00:16:08 +02:00

trace_summary.go

feat(ui): give Operate and Studio a front door, and fix two layout regressions (#11305)

2026-08-03 00:16:08 +02:00

trace.go

feat(kimodo): Add observability hooks (#12184)

2026-09-22 07:06:32 +00:00

usage_stamp.go

feat(kimodocpp): track usage through generic backend metadata (#12162)

2026-09-20 19:39:06 +01:00

usage_test.go

feat(kimodocpp): track usage through generic backend metadata (#12162)

2026-09-20 19:39:06 +01:00

usage.go

feat(kimodocpp): track usage through generic backend metadata (#12162)

2026-09-20 19:39:06 +01:00