Abdullah Mansour | عبد الله منصور a98501d6ce docs(llama-cpp): clarify multimodal speculative decoding (#11700) ...

* docs(llama-cpp): clarify multimodal speculative decoding

Update the speculative decoding guidance now that modern llama.cpp backends can combine mmproj-based vision with speculative decoding, including MTP. Document compatibility checks, draft acceptance statistics, VRAM tradeoffs, and a combined configuration example.

Assisted-by: Codex:GPT-5.6-Sol [gh] [OpenStack] [Docker]
Signed-off-by: Abdullah Mansour <abdullahmansour.marketing@gmail.com>

* docs(llama-cpp): clarify multimodal MTP references

Distinguish the upstream change that removed the general multimodal speculative restriction from the later change that added MTP with explicit vision compatibility.

Assisted-by: Codex:GPT-5.6-Sol [gh] [Docker]
Signed-off-by: Abdullah Mansour <abdullahmansour.marketing@gmail.com>

---------

Signed-off-by: Abdullah Mansour <abdullahmansour.marketing@gmail.com>

2026-09-05 23:46:24 +02:00

..

_index.en.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

advanced-usage.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

model-configuration.md

docs(llama-cpp): clarify multimodal speculative decoding (#11700)

2026-09-05 23:46:24 +02:00

reverse-proxy-tls.md

docs: add Apache APISIX reverse proxy example (#11294)

2026-08-28 08:51:38 +02:00

vram-management.md

fix(vram): persist remote probe metadata (#11487)

2026-08-23 08:55:13 +02:00