mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-07-08 15:28:23 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
d521608e6d10975e8e493f1ecd567d68802aa34f
LocalAI/backend/cpp/llama-cpp/grpc-server.cpp
Roman Mazurenko a3fdfbc0d1 feat(llama-cpp): add device selection option (#10724) 
Allow llama.cpp model configs to select the backend devices used for offload, matching upstream --device behavior so users can exclude a display or debug GPU.

Signed-off-by: rvmzes <rvmzes@rvmzess-MacBook-Pro.local>
Co-authored-by: rvmzes <rvmzes@rvmzess-MacBook-Pro.local>
2026-07-07 20:09:05 +00:00

174 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink