mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-04-29 11:37:40 -04:00
Code Issues Packages Projects Releases Wiki Activity

fix(ik-llama-cpp): patch clip.cpp for new ggml_quantize_chunk signature (#9531)

Browse Source 
Bumps ik_llama.cpp pin to 16996aeab7. Upstream 286ce32...16996ae adds a
trailing `const struct quantize_user_data *` parameter to
`ggml_quantize_chunk` (PR ikawrakow/ik_llama.cpp#1677) but leaves
`examples/llava/clip.cpp` unchanged because their build has moved to
`examples/mtmd/`. LocalAI's prepare.sh still copies from
`examples/llava/`, so the dead 7-arg call reaches the grpc-server
compile and fails. Patch the call site to pass `nullptr` for the new
param.

Assisted-by: Claude:Opus-4.7 [Read] [Edit] [Bash]
This commit is contained in:
Ettore Di Giacinto
2026-04-24 13:07:26 +02:00
committed by GitHub
parent 7c1934b183
commit c0920f3273
2 changed files with 12 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backend/cpp/ik-llama-cpp/Makefile
View File

@@ -1,5 +1,5 @@
IK_LLAMA_VERSION?=286ce324baed17c95faec77792eaa6bdb1c7a5f5
IK_LLAMA_VERSION?=16996aeab772c69b6473597038b2ef0b85297e8b
LLAMA_REPO?=https://github.com/ikawrakow/ik_llama.cpp
CMAKE_ARGS?=

11
backend/cpp/ik-llama-cpp/patches/0002-clip-ggml-quantize-chunk-user-data.patch Normal file
View File

@@ -0,0 +1,11 @@
--- a/examples/llava/clip.cpp
+++ b/examples/llava/clip.cpp
@@ -2494,7 +2494,7 @@
}
new_data = work.data();
- new_size = ggml_quantize_chunk(new_type, f32_data, new_data, 0, n_elms/cur->ne[0], cur->ne[0], nullptr);
+ new_size = ggml_quantize_chunk(new_type, f32_data, new_data, 0, n_elms/cur->ne[0], cur->ne[0], nullptr, nullptr);
} else {
new_type = cur->type;
new_data = cur->data;