Richard Palethorpe 9c43b2da8f fix(model): make backend shutdown model-scoped (#10865) ...

Avoid holding the global loader lock across backend lifecycle waits and propagate forced shutdown through distributed workers. Track parallel requests with in-flight counters and reserve worker ports until process termination.

Add focused race tests and an authoritative FizzBee lifecycle model with a fail-closed conformance target.

Assisted-by: Codex:GPT-5 [FizzBee] [Ginkgo]

Signed-off-by: Richard Palethorpe <io@richiejp.com>

2026-07-19 08:43:17 +02:00

..

audio

feat(localvqe/audio): v1.3 release and add spectrograms to audio transform UI (#10113)

2026-05-31 23:56:46 +02:00

clusterrouting

refactor(routing): extract replica picker into pkg/clusterrouting (#10123)

2026-06-01 09:38:55 +02:00

concurrency

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

distributedhdr

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

downloader

feat: materialize Hugging Face model artifacts (#10825)

2026-07-15 01:09:33 +02:00

functions

refactor: use the built-in max/min to simplify the code (#10657)

2026-07-03 17:59:26 +02:00

grpc

fix(model): make backend shutdown model-scoped (#10865)

2026-07-19 08:43:17 +02:00

httpclient

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

huggingface-api

refactor: replace Split in loops with more efficient SplitSeq (#10879)

2026-07-17 22:07:16 +02:00

mcp/localaitools

feat(vram): per-node VRAM allocation budget (LOCALAI_VRAM_BUDGET) (#10833)

2026-07-15 09:58:45 +02:00

model

fix(model): make backend shutdown model-scoped (#10865)

2026-07-19 08:43:17 +02:00

modelartifacts

fix(model-artifacts): load single-file HF snapshots from the file, not the directory (#10909)

2026-07-17 22:42:50 +00:00

natsauth

fix(distributed): missing agent NATS permissions (#10571)

2026-06-28 12:58:13 +02:00

oci

fix(oci): retry layer downloads on transient network errors (#10579)

2026-06-28 21:21:08 +02:00

radixtree

feat: prefix-cache-aware routing for distributed mode (#10071)

2026-05-30 23:24:22 +02:00

reasoning

fix(reasoning): stop prefilled <think> from swallowing tag-less answers (#10225)

2026-06-09 09:02:04 +02:00

sanitize

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

signals

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

sound

feat(realtime): Semantic VAD EOU token (#10444)

2026-06-30 09:01:22 +02:00

store

fix(backends): refuse foreign model loads in opus and local-store (#10769)

2026-07-11 09:17:34 +02:00

system

feat(backends): make PreferDevelopmentBackends install the development image as primary (#10520)

2026-06-26 07:42:45 +02:00

utils

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

vram

fix(vram): report largest GGUF quant instead of whole HF repo for gallery size (#10700) (#10707)

2026-07-07 11:50:27 +00:00

vrambudget

feat(vram): per-node VRAM allocation budget (LOCALAI_VRAM_BUDGET) (#10833)

2026-07-15 09:58:45 +02:00

xio

feat(ui): allow to cancel ops (#7264)

2025-11-13 18:41:47 +01:00

xsync

chore: fix go.mod module (#2635)

2024-06-23 08:24:36 +00:00

xsysinfo

refactor: replace Split in loops with more efficient SplitSeq (#10879)

2026-07-17 22:07:16 +02:00