Ettore Di Giacinto 522644e4b6 docs: add RKLLM Rockchip NPU integration ...

Document how to connect LocalAI to the upstream RKLLM OpenAI-compatible server through cloud-proxy, including supported SoCs and current limitations.

Assisted-by: Codex:gpt-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-09-11 21:49:51 +00:00

..

_index.en.md

feat(chat): local-ai chat is now a terminal agent (#11291)

2026-08-02 09:23:26 +02:00

3d-generation.md

fix(react-ui): restore 3D Studio results and history (#11393)

2026-08-06 17:34:46 +02:00

agent-actions.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

agents.md

fix(ui): send collection intervals as numbers

2026-09-05 22:09:16 +00:00

api-discovery.md

fix(auth): protect HTTP routes by default (#11602)

2026-08-19 20:49:19 +02:00

audio-classification.md

fix(distributed): stage sound detection audio (#11907)

2026-09-07 17:12:37 +02:00

audio-cpp.md

fix(gallery): default audio-cpp models to backend:best (#11892)

2026-09-08 08:45:17 +02:00

audio-diarization.md

feat(nemo-speech-cpp): add the NVIDIA NeMo-Speech.cpp backend (#11406)

2026-08-07 12:32:39 +02:00

audio-to-text.md

fix(whisperx): reject unconfigured diarization

2026-09-05 22:09:16 +00:00

audio-transform.md

fix(audio): reject incompatible transform streams (#11565)

2026-08-18 09:03:16 +02:00

authentication.md

fix(auth): bypass API-key auth for CORS preflight (OPTIONS) requests (#11113)

2026-09-11 17:57:09 +02:00

backends.md

docs: add RKLLM Rockchip NPU integration

2026-09-11 21:49:51 +00:00

constrained_grammars.md

feat(api): add text moderation endpoint (#11316)

2026-08-03 18:03:46 +02:00

context-compression.md

feat(chat): add end-to-end context compression (#11556)

2026-08-18 11:31:03 +00:00

distributed_inferencing.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

distributed-mode.md

fix(distributed): aggregate prefix cache pressure

2026-09-11 21:48:07 +00:00

embeddings.md

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

face-recognition.md

feat(faces): replay saved face enrollments (#11908)

2026-09-07 17:40:27 +02:00

fine-tuning.md

fix(trl): disable inline GRPO reward code by default (RCE, #11015) (#11068)

2026-07-23 23:10:34 +02:00

gpt-vision.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

GPU-acceleration.md

feat(sycl): make the intel llama.cpp backend self-contained on any host (#10991)

2026-07-31 23:39:53 +02:00

image-generation.md

fix(diffusers): forward original config for single files

2026-09-11 21:47:55 +00:00

interleaved-thinking.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

localai-assistant.md

feat(chat): local-ai chat is now a terminal agent (#11291)

2026-08-02 09:23:26 +02:00

mcp.md

fix: Show MCP connection errors in the UI (#11495)

2026-08-13 22:25:58 +02:00

mlx-distributed.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

model-aliases.md

feat(distributed): key scheduling rules by a model alias (#11771)

2026-08-29 09:16:50 +02:00

model-gallery.md

feat(gallery): add Huihui Qwen3.8 Flash Next (#11921)

2026-09-11 15:27:31 +02:00

moderation.md

feat(api): add text moderation endpoint (#11316)

2026-08-03 18:03:46 +02:00

nemo-speech-cpp.md

feat(nemo-speech-cpp): add the NVIDIA NeMo-Speech.cpp backend (#11406)

2026-08-07 12:32:39 +02:00

object-detection.md

fix(ci): repair nightly backend dep bumps for renamed localai-org repos (#11012)

2026-07-21 09:40:10 +02:00

openai-functions.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

openai-realtime.md

fix(realtime): accept GA WebRTC signaling (#11778)

2026-08-29 21:28:37 +02:00

quantization.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

reranker.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

rkllm.md

docs: add RKLLM Rockchip NPU integration

2026-09-11 21:49:51 +00:00

runtime-settings.md

fix(vram): persist remote probe metadata (#11487)

2026-08-23 08:55:13 +02:00

stores.md

feat(stores): add Valkey Search vector store backend (#11196)

2026-07-29 20:12:29 +02:00

terminal-agent.md

feat(chat): local-ai chat is now a terminal agent (#11291)

2026-08-02 09:23:26 +02:00

text-generation.md

fix(openresponses): support Codex WebSocket warm-up (#11608)

2026-09-11 16:54:42 +02:00

text-to-audio.md

fix(fish-speech): use CUDA toolkit ptxas

2026-09-11 21:48:54 +00:00

tracing.md

feat(traces): show in-flight API requests (#11368)

2026-08-05 09:37:05 +02:00

video-generation.md

feat(vllm-cpp): serve MiniMax-H3 video+audio generation (#11424)

2026-08-09 22:34:51 +02:00

vllm-cpp.md

feat(gallery): add vllm.cpp text-generation models (#11511)

2026-08-16 00:32:37 +02:00

voice-activity-detection.md

feat(audio-cpp): add the audio.cpp native backend (#11141)

2026-07-30 12:11:56 +02:00

voice-recognition.md

fix(ci): repair nightly backend dep bumps for renamed localai-org repos (#11012)

2026-07-21 09:40:10 +02:00

whisper-medusa.md

feat(backends): add Whisper-Medusa transcription

2026-09-11 21:48:07 +00:00