mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-03-22 08:44:39 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
c4186f13c33836244a5991f31175ccd072a5fcaf
LocalAI/backend/cpp/llama/grpc-server.cpp
Ettore Di Giacinto e49ea0123b feat(llama.cpp): add flash_attention and no_kv_offloading (#2310) 
feat(llama.cpp): add flash_attn and no_kv_offload

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-05-13 19:07:51 +02:00

90 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink