Files
LocalAI/backend/cpp/llama-cpp/grpc-server.cpp
localai-org-maint-bot 40bae01e40 fix(llama-cpp): preserve GPU layers during option passthrough
Stage the negative GPU-layer sentinels expected by the upstream argument parser, then restore LocalAI resolved values unless a passthrough flag explicitly overrides them. This avoids the parser assertion that terminated the backend for any generic option.

Assisted-by: Codex:gpt-5
2026-07-29 14:10:03 +00:00

180 KiB