Files
LocalAI/core
leilei3167 a95ef3e7f3 fix(backend): re-probe MediaMarker after cold vision model load (#12254)
llama.cpp picks a new random media marker per backend process. LocalAI
cached the first probe on the model config and skipped later probes when
MediaMarker was non-empty, so after SINGLE_ACTIVE eviction/reload the
prompt still used the stale marker and mtmd_tokenize failed (0 markers
vs 1 bitmap).

Re-probe whenever the model was not already resident before Load, while
still skipping the RPC on warm cache hits.

Fixes #12246

Assisted-by: Cursor:composer-2.5

Signed-off-by: leilei3167 <imleilei123@gmail.com>
2026-09-25 09:16:33 +02:00
..
2026-03-30 00:47:27 +02:00