leilei3167 a95ef3e7f3 fix(backend): re-probe MediaMarker after cold vision model load (#12254) ...

llama.cpp picks a new random media marker per backend process. LocalAI
cached the first probe on the model config and skipped later probes when
MediaMarker was non-empty, so after SINGLE_ACTIVE eviction/reload the
prompt still used the stale marker and mtmd_tokenize failed (0 markers
vs 1 bitmap).

Re-probe whenever the model was not already resident before Load, while
still skipping the RPC on warm cache hits.

Fixes #12246

Assisted-by: Cursor:composer-2.5

Signed-off-by: leilei3167 <imleilei123@gmail.com>

2026-09-25 09:16:33 +02:00

..

animation.go

feat(kimodo): Add observability hooks (#12184)

2026-09-22 07:06:32 +00:00

audio_transform.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

backend_suite_test.go

feat: extract output with regexes from LLMs (#3491)

2024-09-13 13:27:36 +02:00

companion_options_test.go

fix(model-artifacts): materialize longcat-video on the controller, and support companion repos (#10949)

2026-07-19 12:01:36 +02:00

ctx_propagation_test.go

fix(distributed): keep model replicas config-consistent (#11664)

2026-08-22 22:44:03 +02:00

depth.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

detection.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

detokenize.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

diarization_test.go

feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp (#9654)

2026-05-05 15:10:13 +02:00

diarization.go

fix(distributed): reject wrong-model requests on the remaining modalities (#10990)

2026-07-20 21:58:19 +02:00

embeddings.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

face_analyze.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

face_embed.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

face_verify.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

global_admission_test.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

global_admission.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

image.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

llm_probe_test.go

fix(backend): re-probe MediaMarker after cold vision model load (#12254)

2026-09-25 09:16:33 +02:00

llm_test.go

feat(autoparser): prefer chat deltas from backends when emitted (#9224)

2026-04-04 12:12:08 +02:00

llm.go

fix(backend): re-probe MediaMarker after cold vision model load (#12254)

2026-09-25 09:16:33 +02:00

model3d.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

model_artifact_options_test.go

feat: materialize Hugging Face model artifacts (#10825)

2026-07-15 01:09:33 +02:00

model_identity_modalities_test.go

fix(distributed): keep model replicas config-consistent (#11664)

2026-08-22 22:44:03 +02:00

model_load_trace_test.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

options_internal_test.go

fix(diffusers): forward original config for single files

2026-09-11 21:47:55 +00:00

options.go

fix(openai): return HTTP errors for pre-stream failures and report per-slot context (#12204)

2026-09-22 17:19:58 +02:00

pooling_test.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

pooling.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

prefix_source_internal_test.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

prefix_source.go

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

preload_internal_test.go

feat(classifier/VAD): support voice control on low power devices (#10804)

2026-07-29 12:50:22 +02:00

preload.go

feat(classifier/VAD): support voice control on low power devices (#10804)

2026-07-29 12:50:22 +02:00

request_context_test.go

fix(openai): return HTTP errors for pre-stream failures and report per-slot context (#12204)

2026-09-22 17:19:58 +02:00

rerank.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

score_test.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

score.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

sound_classification.go

fix(distributed): reject wrong-model requests on the remaining modalities (#10990)

2026-07-20 21:58:19 +02:00

soundgeneration.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

stores_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

stores.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

token_classify_test.go

feat(pii): NER tier engine — privacy-filter.cpp backend + NER-centric PII filter (#10360)

2026-06-18 11:45:22 +01:00

token_classify.go

feat(vllm-cpp): add GLiNER2.5 NER via TokenClassify (#12140)

2026-09-23 12:31:28 +02:00

token_metrics.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

tokenize_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

tokenize.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

transcript_live_internal_test.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

transcript_live.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

transcript.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

tts_test.go

fix(distributed): reject wrong-model requests on the remaining modalities (#10990)

2026-07-20 21:58:19 +02:00

tts.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

upscale.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

vad.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

video.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

voice_analyze.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

voice_embed.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00

voice_verify.go

feat: bound global admission and expose running backend traces (#11560)

2026-08-18 08:56:59 +02:00