localai-org-maint-bot 4fdfba79b3 fix(p2p): balance active federated connections ...

Reserve capacity when selecting a worker and release it when forwarding
ends. Completed connections no longer bias routing toward new workers.
Keep active counts through offline periods and choose randomly on ties.

Add regression tests and document per-instance TCP connection counts.

Fixes #12992

Assisted-by: Codex:gpt-6
(cherry picked from commit 66cf106490)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-11-03 19:18:06 +00:00

..

_index.en.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

3d-animation.md

feat(kimodo): Add observability hooks (#12184)

2026-09-22 07:06:32 +00:00

3d-generation.md

feat: Add kimodo.cpp and 3D animation API/UI (#12095)

2026-09-18 06:12:03 +01:00

addons.md

feat(studio): enforce the action policy of unattended runs

2026-11-03 19:12:29 +00:00

agent-jobs.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

agents.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

api-discovery.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

audio-classification.md

feat(diarization): return sound events with include_sounds (#12544)

2026-10-07 14:10:45 +02:00

audio-cpp.md

fix(gallery): pin Stable Audio SFX weights

2026-11-03 14:40:50 +00:00

audio-diarization.md

feat(diarization): return sound events with include_sounds (#12544)

2026-10-07 14:10:45 +02:00

audio-to-text.md

feat(realtime): LFM3-Audio speech-to-speech on llama.cpp, remove liquid-audio (#12958)

2026-10-29 22:06:41 +01:00

audio-transform.md

feat(realtime): LFM3-Audio speech-to-speech on llama.cpp, remove liquid-audio (#12958)

2026-10-29 22:06:41 +01:00

authentication.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

backends.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

benchmark.md

feat(cli): benchmark configured text models (#12020)

2026-09-13 19:06:43 +02:00

chats-agents.md

feat(studio): enforce the action policy of unattended runs

2026-11-03 19:12:29 +00:00

chats-connectors.md

feat(studio): enforce the action policy of unattended runs

2026-11-03 19:12:29 +00:00

chats-migration.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

chats.md

feat(ui): list agent skills on the Skills page

2026-11-03 19:10:39 +00:00

collections.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

constrained_grammars.md

feat(api): add text moderation endpoint (#11316)

2026-08-03 18:03:46 +02:00

context-compression.md

feat(chat): add end-to-end context compression (#11556)

2026-08-18 11:31:03 +00:00

decisions.md

fix(backends): flag a llama-cpp backend that predates native decisions (#12733)

2026-10-16 10:41:45 +02:00

diagnostics.md

fix(chat): defer model fallback until after binding (#12621)

2026-10-11 00:26:40 +02:00

distributed_inferencing.md

fix(p2p): balance active federated connections

2026-11-03 19:18:06 +00:00

distributed-mode.md

docs(addons): document add-on roles, distributed owner, delivery and Sandbox isolation

2026-11-03 08:41:10 +00:00

embeddings.md

fix: stop listing the models directory on request paths and cache GGUF header reads (#12683)

2026-10-14 01:06:14 +02:00

face-recognition.md

feat(addons): declare typed host capabilities (#13034)

2026-11-02 23:50:40 +00:00

fine-tuning.md

feat(addons): declare typed host capabilities (#13034)

2026-11-02 23:50:40 +00:00

forecast.md

feat(backends): timestral.cpp forecast backend and /v1/forecast API (#12885)

2026-10-24 22:47:04 +02:00

gpt-vision.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

GPU-acceleration.md

fix(xsysinfo): read AMD GPU memory from sysfs when rocm-smi is missing

2026-11-03 09:17:42 +00:00

image-generation.md

feat(images): add ESRGAN upscaling and Studio workflow (#12620)

2026-10-11 00:30:09 +02:00

interleaved-thinking.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

localai-assistant.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

make-localai-yours.md

docs(addons): document context files for add-on authors

2026-11-03 09:28:57 +00:00

mcp.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

mlx-distributed.md

fix(p2p): print the p2p-worker command, not the pre-v4 worker one

2026-11-03 09:21:06 +00:00

model-aliases.md

feat(config): let model aliases carry an opt-in profile block (system prompt, MCP, client tools) (#12661)

2026-10-19 23:42:40 +02:00

model-failover.md

feat(ui): redesign the web UI around a shared kit and a calm palette (#12526)

2026-10-08 22:03:07 +02:00

model-gallery.md

feat(gallery): add Nemotron Bolt E4B variants (#12880)

2026-10-24 23:50:41 +02:00

moderation.md

feat(api): add text moderation endpoint (#11316)

2026-08-03 18:03:46 +02:00

motion.md

feat(motion): add GEM-X backend and duplex streaming API

2026-10-13 08:27:24 +00:00

nemo-speech-cpp.md

[gallery] feat: add Orukeet to the NeMo speech backend (#11998)

2026-09-13 01:51:19 +02:00

object-detection.md

fix(ci): repair nightly backend dep bumps for renamed localai-org repos (#11012)

2026-07-21 09:40:10 +02:00

openai-functions.md

test(vllm): isolate streaming parser fixtures

2026-10-25 08:50:00 +00:00

openai-realtime.md

docs(realtime): explain transcript language tags

2026-11-03 14:40:50 +00:00

pages.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

quantization.md

feat(addons): declare typed host capabilities (#13034)

2026-11-02 23:50:40 +00:00

reranker.md

docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)

2026-07-17 22:08:20 +02:00

rkllm.md

docs: add RKLLM Rockchip NPU integration

2026-09-11 21:49:51 +00:00

runtime-settings.md

refactor(studio): word the command provider text without naming an add-on

2026-11-03 10:43:37 +00:00

short-memory.md

feat(addons): add the Short memory add-on

2026-11-03 13:57:28 +00:00

simple-office.md

feat(addons): simplify Office and discover Tables (#13029)

2026-11-02 12:48:08 +01:00

stores.md

fix(qdrant-store): warn about non-COSINE metrics and document them

2026-10-13 08:13:55 +00:00

studio.md

feat(addons): declare typed host capabilities (#13034)

2026-11-02 23:50:40 +00:00

tables.md

docs(addons): document the resource listing declaration

2026-11-03 10:24:42 +00:00

terminal-agent.md

feat(chat): local-ai chat is now a terminal agent (#11291)

2026-08-02 09:23:26 +02:00

text-generation.md

fix(anthropic): honor object tool_choice on /v1/messages

2026-11-03 14:40:50 +00:00

text-to-audio.md

feat(realtime): LFM3-Audio speech-to-speech on llama.cpp, remove liquid-audio (#12958)

2026-10-29 22:06:41 +01:00

tracing.md

feat(ui): redesign the web UI around a shared kit and a calm palette (#12526)

2026-10-08 22:03:07 +02:00

video-generation.md

stablediffusion-ggml: run MiniMax-H3 video with references and add its gallery entries (#12668)

2026-10-13 17:58:21 +02:00

vllm-cpp.md

chore(vllm-cpp): bump to 967883486 (ABI v30), add hf_overrides and Tev1 entries, fix vllm-cpp gallery installs (#12379)

2026-09-30 20:22:49 +02:00

voice-activity-detection.md

feat(parakeet-cpp): encoder fingerprint for speaker naming, VAD trim and word filter options, pin bump (#12491)

2026-10-05 15:57:16 +02:00

voice-recognition.md

feat(addons): declare typed host capabilities (#13034)

2026-11-02 23:50:40 +00:00

web.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00

whisper-medusa.md

feat(backends): add Whisper-Medusa transcription

2026-09-11 21:48:07 +00:00

workspace-feed.md

feat(chats): server-side chats with steering, sub-agents and compaction (#12918)

2026-11-01 12:08:23 +01:00