3 people 2200489044 chore: ⬆️ Update ggml-org/llama.cpp to 78a8ae14be559b45f5f13ddee82c188b683d5d8d (#12741) ...

* ⬆️ Update ggml-org/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* fix(llama-cpp): adapt to the multimodal rerank signature

Upstream llama.cpp added query_files and doc_files parameters to
format_prompt_rerank() (ggml-org/llama.cpp#29625). The gRPC rerank
call passed the init options in their place, so grpc-server.cpp no
longer compiled against the new pin.

prepare.sh now probes server-common.h for query_files and writes
LOCALAI_HAS_RERANK_FILES into llama_compat.h. When it is set, the
rerank call passes two empty media lists. The rerank API is text
only, so behaviour is unchanged. Forks that still use the old
signature (turboquant, bonsai) compile as before.

Assisted-by: Claude:claude-sonnet-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>

2026-10-25 10:54:23 +01:00

..

patches

feat(gallery): add flint and bump llama.cpp to a37cc461 (#12854)

2026-10-23 15:58:25 +02:00

tests

feat(router): route with native decision models (#12449)

2026-10-04 09:34:21 +02:00

CMakeLists.txt

feat(llama-cpp): add slot prompt-cache save and restore API (#12730)

2026-10-17 18:23:02 +02:00

decision_compat_test.cpp

feat(router): route with native decision models (#12449)

2026-10-04 09:34:21 +02:00

decision_compat.h

feat(router): route with native decision models (#12449)

2026-10-04 09:34:21 +02:00

decision_images.h

feat(router): route with native decision models (#12449)

2026-10-04 09:34:21 +02:00

disable-score-task.sh

feat(classifier/VAD): support voice control on low power devices (#10804)

2026-07-29 12:50:22 +02:00

disable-tts-task.sh

feat(llama-cpp): serve Qwen3-TTS through the llama.cpp backend (#11392)

2026-08-10 10:18:47 +02:00

grpc-server.cpp

chore: ⬆️ Update ggml-org/llama.cpp to 78a8ae14be559b45f5f13ddee82c188b683d5d8d (#12741)

2026-10-25 10:54:23 +01:00

Makefile

chore: ⬆️ Update ggml-org/llama.cpp to 78a8ae14be559b45f5f13ddee82c188b683d5d8d (#12741)

2026-10-25 10:54:23 +01:00

message_content_test.cpp

fix(llama-cpp): stop reinterpreting plain-string message content as JSON (#10524) (#10538)

2026-06-27 01:42:05 +02:00

message_content.h

chore: ⬆️ Update ggml-org/llama.cpp to f280b26983ad0fdb705a0d9ebf0503e76f2899b0 (#11646)

2026-08-25 12:57:12 +02:00

model_load_error_test.cpp

fix(llama-cpp): explain tensor count mismatch

2026-09-11 21:55:14 +00:00

model_load_error.h

fix(llama-cpp): explain tensor count mismatch

2026-09-11 21:55:14 +00:00

moe_cache_option_test.cpp

feat(llama-cpp): bump llama.cpp and add moe_cache_mib option (#12729)

2026-10-16 00:55:55 +02:00

moe_cache_option.h

feat(llama-cpp): bump llama.cpp and add moe_cache_mib option (#12729)

2026-10-16 00:55:55 +02:00

package.sh

feat(router): route with native decision models (#12449)

2026-10-04 09:34:21 +02:00

parallel_params_test.cpp

fix(llama-cpp): let parallel:1 in the model options win over LLAMACPP_PARALLEL (#12426)

2026-10-02 09:17:44 +02:00

parallel_params.h

fix(llama-cpp): let parallel:1 in the model options win over LLAMACPP_PARALLEL (#12426)

2026-10-02 09:17:44 +02:00

parent_watch_test.cpp

fix(process): give backend workers a parent-death safety net (#10639)

2026-07-02 19:16:48 +02:00

parent_watch.h

fix(process): give backend workers a parent-death safety net (#10639)

2026-07-02 19:16:48 +02:00

passthrough_options_test.cpp

fix(llama-cpp): preserve GPU layers during option passthrough (#11193)

2026-07-30 15:54:05 +02:00

passthrough_options.h

fix(llama-cpp): preserve GPU layers during option passthrough (#11193)

2026-07-30 15:54:05 +02:00

prepare.sh

chore: ⬆️ Update ggml-org/llama.cpp to 78a8ae14be559b45f5f13ddee82c188b683d5d8d (#12741)

2026-10-25 10:54:23 +01:00

run.sh

fix(rocm): point *_TENSILE_LIBPATH at the architecture folder (#12411)

2026-10-05 01:38:09 +02:00

slot_cache_test.cpp

feat(llama-cpp): add slot prompt-cache save and restore API (#12730)

2026-10-17 18:23:02 +02:00

slot_cache.h

feat(llama-cpp): add slot prompt-cache save and restore API (#12730)

2026-10-17 18:23:02 +02:00

stream_peer_test.cpp

fix(llama-cpp): stop a generation whose stream is gone

2026-09-11 23:13:32 +00:00

stream_peer.h

fix(llama-cpp): stop a generation whose stream is gone

2026-09-11 23:13:32 +00:00

thread_params_test.cpp

chore: ⬆️ Update ggml-org/llama.cpp to 0021a77de0a8966059dc94548fb3b96654e0bb12 (#11508)

2026-08-18 09:45:56 +02:00

thread_params.h

chore: ⬆️ Update ggml-org/llama.cpp to 0021a77de0a8966059dc94548fb3b96654e0bb12 (#11508)

2026-08-18 09:45:56 +02:00

tts_request_options_test.cpp

feat(llama-cpp): serve Qwen3-TTS through the llama.cpp backend (#11392)

2026-08-10 10:18:47 +02:00

tts_request_options.h

feat(llama-cpp): serve Qwen3-TTS through the llama.cpp backend (#11392)

2026-08-10 10:18:47 +02:00