mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 17:18:49 -04:00
G ManandEttore Di Giacinto
3934ee8e34
mlx-vlm v0.4.4 attaches the image placeholder to the last message that is not system or assistant. After a tool call that is the tool result, which the chat template renders as text, so the next turn fails with "Image features and image tokens do not match: tokens: 0". v0.6.12 keeps the placeholder on the user message that carried the image. The v0.4.4 pin (#9568) worked around the mlx-cuda wheels stopping at 0.31.1. They are at 0.32.4 now, and v0.6.12 (mlx>=0.32.0) resolves with mlx[cuda12] and mlx[cuda13]. v0.7.x would need backend changes: it drops mlx_vlm.tool_parsers, which backend.py imports. Signed-off-by: gman <genx7up@users.noreply.github.com> Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>