mudler-agentandEttore Di Giacinto 849c177834 feat(llama-cpp): bump llama.cpp and add moe_cache_mib option (#12729) ...

Bump LLAMA_VERSION to b76b13379d3b (upstream 0.7.0 plus later
commits). This is the same one-line change as the bot PR #12725.

Add the moe_cache_mib model option. It sets upstream's
moe_cache_size, a GPU cache for MoE experts kept in host memory,
from a size in MiB. It is off by default. Invalid, negative or
non-numeric values are ignored with a log line. Forks that predate
the field ignore the option, using the same prepare.sh probe as the
other fork-skew switches.

Document the option, and cover the MiB to bytes conversion with a
standalone unit test.

Assisted-by: Claude:claude-sonnet-5-5 g++

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>

2026-10-16 00:55:55 +02:00

..

_index.en.md

docs: fix dead anchors and a dead section link (#11885)

2026-09-05 23:47:13 +02:00

advanced-usage.md

docs: point the config example link at the configurations directory

2026-09-27 19:06:33 +00:00

embedded-routing-log.md

feat(router): route with native decision models (#12449)

2026-10-04 09:34:21 +02:00

model-configuration.md

feat(llama-cpp): bump llama.cpp and add moe_cache_mib option (#12729)

2026-10-16 00:55:55 +02:00

private-sources.md

feat(gallery): galleries published as OCI artifacts (#12167)

2026-09-21 09:23:05 +02:00

reverse-proxy-tls.md

docs: add Apache APISIX reverse proxy example (#11294)

2026-08-28 08:51:38 +02:00

vram-management.md

fix(distributed): exclude pinned models from cluster eviction and idle scale-down

2026-09-11 23:08:26 +00:00