mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-07-31 10:28:43 -04:00
Code Issues Packages Projects Releases Wiki Activity

fix(cachyllama): link SSD cache implementation

Browse Source 
CachyLLaMA splits persistent prompt-cache support into separate source files. Include those implementations in the monolithic LocalAI gRPC adapter when the fork provides them so the ARM64 fallback build resolves the page-manager symbols.

Assisted-by: Codex:gpt-5 [Codex]
This commit is contained in:
localai-org-maint-bot
2026-07-31 03:06:34 +00:00
parent 0a063c57af
commit 06506529ea
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
backend/cpp/llama-cpp/grpc-server.cpp
View File

@@ -43,6 +43,15 @@
#if __has_include("server-stream.cpp")
#include "server-stream.cpp"
#endif
// CachyLLaMA splits its persistent prompt-cache implementation out of
// server-context.cpp. Pull both implementation files into this monolithic
// adapter TU when present; older llama.cpp pins do not ship them.
#if __has_include("server-context-ssd-cache.cpp")
#include "server-context-ssd-cache.cpp"
#endif
#if __has_include("server-context-page-manager.cpp")
#include "server-context-page-manager.cpp"
#endif
#include "server-context.cpp"
// LocalAI