LocalAI/backend/cpp/llama-cpp/grpc-server.cpp at 424acd66adab533cf4bd7e687d49dc68a45b7a39

mirror of https://github.com/mudler/LocalAI.git synced 2026-01-01 02:49:19 -05:00

Files

Ettore Di Giacinto 424acd66ad feat(llama.cpp): allow to set cache-ram and ctx_shift (#7009 )

* feat(llama.cpp): allow to set cache-ram and ctx_shift

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Apply suggestion from @mudler

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

2025-11-02 17:33:29 +01:00

42 KiB

Raw Blame History

View Raw

42 KiB Raw Blame History

42 KiB

Raw Blame History