Ettore Di Giacinto d4c1746c7d feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329) ...

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-12-06 10:23:59 +01:00

..

patches

…

CMakeLists.txt

…

grpc-server.cpp

feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329)

2024-12-06 10:23:59 +01:00

json.hpp

…

Makefile

fix(llama.cpp): embed metal file into result binary for darwin (#4279)

2024-11-28 04:17:00 +00:00

prepare.sh

…

utils.hpp

…