Roman Mazurenko a3fdfbc0d1 feat(llama-cpp): add device selection option (#10724) ...

Allow llama.cpp model configs to select the backend devices used for offload, matching upstream --device behavior so users can exclude a display or debug GPU.

Signed-off-by: rvmzes <rvmzes@rvmzess-MacBook-Pro.local>
Co-authored-by: rvmzes <rvmzes@rvmzess-MacBook-Pro.local>

2026-07-07 20:09:05 +00:00

..

_index.en.md

fix(docs): fix broken references to distributed mode

2026-04-03 09:46:06 +02:00

agents.md

chore: bump localrecall for postgres per-connection timeouts (#10517)

2026-06-26 00:53:03 +02:00

api-discovery.md

feat(api): add GET /v1/models/capabilities endpoint (#10687)

2026-07-05 08:51:55 +02:00

audio-classification.md

feat(ced): sound-event classification backend (CED audio tagger) (#10425)

2026-06-22 01:00:28 +02:00

audio-diarization.md

feat(ced): sound-event classification backend (CED audio tagger) (#10425)

2026-06-22 01:00:28 +02:00

audio-to-text.md

feat(parakeet-cpp): real segment timestamps (NeMo-faithful) (#10207)

2026-06-07 22:08:24 +02:00

audio-transform.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

authentication.md

feat(realtime): eager blocking pipeline warm-up + /backend/load API (#10662)

2026-07-03 18:00:37 +02:00

backend-monitor.md

feat(realtime): eager blocking pipeline warm-up + /backend/load API (#10662)

2026-07-03 18:00:37 +02:00

backends.md

feat(ced): sound-event classification backend (CED audio tagger) (#10425)

2026-06-22 01:00:28 +02:00

cloud-proxy.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

constrained_grammars.md

fix(docs): fix broken references to distributed mode

2026-04-03 09:46:06 +02:00

distributed_inferencing.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

distributed-mode.md

feat(distributed): add LOCALAI_DISTRIBUTED_SHARED_MODELS to skip staging on shared volumes (#10556) (#10566)

2026-06-28 01:23:07 +02:00

distribution.md

fix(docs): commit distribution.md

2026-04-03 10:14:13 +02:00

embeddings.md

feat(face-recognition): add insightface/onnx backend for 1:1 verify, 1:N identify, embedding, detection, analysis (#9480)

2026-04-22 21:55:41 +02:00

face-recognition.md

feat(backends): add voice-detect + face-detect ggml backends (replace Python insightface/speaker-recognition) (#10441)

2026-06-28 09:29:08 +02:00

fine-tuning.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

gpt-vision.md

fix(docs): fix broken references to distributed mode

2026-04-03 09:46:06 +02:00

GPU-acceleration.md

feat(rocm): bump to 7.x (#9323)

2026-04-12 08:51:30 +02:00

image-generation.md

fix(docs): use relearn notice shortcode instead of unsupported alert (#10364)

2026-06-16 21:06:20 +02:00

localai-assistant.md

feat: localai assistant chat modality (#9602)

2026-04-28 19:29:27 +02:00

mcp.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

middleware.md

fix(pii): load default detectors at startup + add LOCALAI_PII_DEFAULT_DETECTORS (#10474)

2026-06-24 11:08:57 +02:00

mitm-proxy.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

mlx-distributed.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

model-aliases.md

feat(models): model aliases - redirect a model name to another configured model (#10414)

2026-06-20 22:38:42 +02:00

model-gallery.md

fix(docs): fix broken references to distributed mode

2026-04-03 09:46:06 +02:00

object-detection.md

feat(backend): rfdetr-cpp native object detection + segmentation backend (#10028)

2026-05-27 18:43:57 +02:00

openai-functions.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

openai-realtime.md

feat(realtime): eager blocking pipeline warm-up + /backend/load API (#10662)

2026-07-03 18:00:37 +02:00

p2p.md

feat: Add documentation for undocumented API endpoints (#8852)

2026-03-08 17:59:33 +01:00

quantization.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

reranker.md

docs: architecture & feature diagrams (blueprint style) (#10137)

2026-06-02 18:43:22 +02:00

runtime-settings.md

fix(docs): fix broken references to distributed mode

2026-04-03 09:46:06 +02:00

sound-generation.md

feat: Add documentation for undocumented API endpoints (#8852)

2026-03-08 17:59:33 +01:00

stores.md

fix(docs): replace Docsy alert shortcode with Relearn notice

2026-04-25 21:04:31 +00:00

text-generation.md

feat(llama-cpp): add device selection option (#10724)

2026-07-07 20:09:05 +00:00

text-to-audio.md

feat(omnivoice-cpp): add OmniVoice TTS backend (file + streaming, voice cloning + voice design) (#10310)

2026-06-13 21:28:46 +02:00

video-generation.md

feat: Add documentation for undocumented API endpoints (#8852)

2026-03-08 17:59:33 +01:00

voice-activity-detection.md

feat: Add documentation for undocumented API endpoints (#8852)

2026-03-08 17:59:33 +01:00

voice-recognition.md

feat(backends): add voice-detect + face-detect ggml backends (replace Python insightface/speaker-recognition) (#10441)

2026-06-28 09:29:08 +02:00