Ettore Di Giacinto 6df1767133 fix(localai-proxy): keep rerank, stream errors and chat intact through the proxy ...

Rerank no longer sends top_n 0, which the upstream rejects. A
mid-stream upstream error frame now fails the call instead of ending
it as a short success. Temperature 0 is forwarded. An upstream 429
becomes ResourceExhausted, which failover skips like Unimplemented.

A localai-proxy config sends its own name upstream when upstream_model
is unset, and a chat proxy defaults to the tokenizer template so chat
reaches the upstream as messages.

Assisted-by: Claude:claude-opus-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-09-27 07:42:21 +00:00

..

animation.go

feat(kimodo): Add observability hooks (#12184)

2026-09-22 07:06:32 +00:00

audio_transform.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

backend_suite_test.go

feat: extract output with regexes from LLMs (#3491)

2024-09-13 13:27:36 +02:00

companion_options_test.go

fix(model-artifacts): materialize longcat-video on the controller, and support companion repos (#10949)

2026-07-19 12:01:36 +02:00

ctx_propagation_test.go

fix(distributed): keep model replicas config-consistent (#11664)

2026-08-22 22:44:03 +02:00

depth.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

detection.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

detokenize.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

diarization_test.go

feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp (#9654)

2026-05-05 15:10:13 +02:00

diarization.go

fix(distributed): reject wrong-model requests on the remaining modalities (#10990)

2026-07-20 21:58:19 +02:00

embeddings.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

face_analyze.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

face_embed.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

face_verify.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

global_admission_test.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

global_admission.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

image.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

llm_probe_test.go

fix(backend): re-probe MediaMarker after cold vision model load (#12254)

2026-09-25 09:16:33 +02:00

llm_test.go

feat(autoparser): prefer chat deltas from backends when emitted (#9224)

2026-04-04 12:12:08 +02:00

llm.go

fix(backend): re-probe MediaMarker after cold vision model load (#12254)

2026-09-25 09:16:33 +02:00

model3d.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

model_artifact_options_test.go

feat: materialize Hugging Face model artifacts (#10825)

2026-07-15 01:09:33 +02:00

model_identity_modalities_test.go

fix(distributed): keep model replicas config-consistent (#11664)

2026-08-22 22:44:03 +02:00

model_load_trace_test.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

options_internal_test.go

fix(localai-proxy): keep rerank, stream errors and chat intact through the proxy

2026-09-27 07:42:21 +00:00

options.go

fix(localai-proxy): keep rerank, stream errors and chat intact through the proxy

2026-09-27 07:42:21 +00:00

pooling_test.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

pooling.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

prefix_source_internal_test.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

prefix_source.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

preload_internal_test.go

feat(classifier/VAD): support voice control on low power devices (#10804)

2026-07-29 12:50:22 +02:00

preload.go

feat(classifier/VAD): support voice control on low power devices (#10804)

2026-07-29 12:50:22 +02:00

request_context_test.go

fix(openai): return HTTP errors for pre-stream failures and report per-slot context (#12204)

2026-09-22 17:19:58 +02:00

rerank.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

score_test.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

score.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

sound_classification.go

fix(distributed): reject wrong-model requests on the remaining modalities (#10990)

2026-07-20 21:58:19 +02:00

soundgeneration.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

stores_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

stores.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

systemone.go

feat(vllm-cpp): unify decision pipeline through Score RPC with vllm_decide ABI v29 (#12247)

2026-09-25 23:27:27 +02:00

token_classify_test.go

feat(pii): NER tier engine — privacy-filter.cpp backend + NER-centric PII filter (#10360)

2026-06-18 11:45:22 +01:00

token_classify.go

feat(vllm-cpp): add GLiNER2.5 NER via TokenClassify (#12140)

2026-09-23 12:31:28 +02:00

token_metrics.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

tokenize_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

tokenize.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

transcript_live_internal_test.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

transcript_live.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

transcript.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

tts_test.go

fix(distributed): reject wrong-model requests on the remaining modalities (#10990)

2026-07-20 21:58:19 +02:00

tts.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

upscale.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

vad.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

video.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

voice_analyze.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

voice_embed.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

voice_verify.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00