Ettore Di Giacinto 811f0db2e3 feat(llama-cpp): add main-model cpu_moe/n_cpu_moe options ...

Mirror the existing draft_cpu_moe/draft_n_cpu_moe siblings for the main
model, matching upstream --cpu-moe / --n-cpu-moe (common/arg.cpp). Lets
users keep MoE expert weights on CPU to manage VRAM on large MoE models.

Closes part of #10483

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-24 17:07:14 +00:00

..

CMakeLists.txt

fix(turboquant): resolve common.h by detecting llama-common vs common target (#9413)

2026-04-18 20:30:28 +02:00

grpc-server.cpp

feat(llama-cpp): add main-model cpu_moe/n_cpu_moe options

2026-06-24 17:07:14 +00:00

Makefile

chore: ⬆️ Update ggml-org/llama.cpp to be4a6a63eb2b848e19c277bdcf2bd399e8af76d9 (#10467)

2026-06-24 09:40:54 +02:00

package.sh

fix(llama.cpp): bundle libdl, librt, libpthread in llama-cpp backend (#9099)

2026-03-22 00:58:14 +01:00

prepare.sh

chore: ⬆️ Update ggml-org/llama.cpp to 7f8ef50cce40e3e7e4526a3696cb45658190e69a (#7402)

2025-12-01 07:50:40 +01:00

run.sh

feat(rocm): bump to 7.x (#9323)

2026-04-12 08:51:30 +02:00