mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-01-25 06:42:46 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
functions_string
LocalAI/backend/cpp/llama/grpc-server.cpp
Ettore Di Giacinto e49ea0123b feat(llama.cpp): add flash_attention and no_kv_offloading (#2310) 
feat(llama.cpp): add flash_attn and no_kv_offload

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-05-13 19:07:51 +02:00

90 KiB
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink