Ettore Di Giacinto 47fa847d55 fix(nodes): clear pending backend ops behind offline/draining nodes ...

ListDuePendingBackendOps filters status=healthy, so a backend op queued against
a node that went offline (stale heartbeat) or draining (admin action) was never
retried, aged out, or deleted - it leaked forever and kept the UI operation
spinning. Add DeleteStalePendingBackendOps and run it each reconcile pass:
draining nodes are cleared immediately (model rows already purged), offline
nodes once their heartbeat is older than a grace window (blip protection).

Reproduced on a live cluster: orphaned llama-cpp install rows targeting an
offline (nvidia-thor) and a draining (mac-mini-m4) node sat at attempts=0
indefinitely.

Assisted-by: Claude:claude-opus-4-8 [Claude Code]
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-07 22:37:24 +00:00

..

advisorylock

feat(distributed): sync state with frontends, better backend management reporting (#9426)

2026-04-19 17:55:53 +02:00

agentpool

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

agents

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

cloudproxy

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

dbutil

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

distributed

fix(distributed): sync gallery OpCache + caches across frontend replicas (#9983)

2026-05-25 17:28:14 +02:00

facerecognition

feat(face-recognition): add insightface/onnx backend for 1:1 verify, 1:N identify, embedding, detection, analysis (#9480)

2026-04-22 21:55:41 +02:00

finetune

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

galleryop

fix(galleryop): self-evict terminal ops from OpCache.GetStatus

2026-06-07 22:31:04 +00:00

jobs

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

mcp

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

messaging

feat(distributed): Add NATS JWT authentication and TLS/mTLS options (#10159)

2026-06-03 19:43:56 +02:00

modeladmin

feat(gallery): Speed up load times and clean gallery entries (#9211)

2026-05-06 14:51:38 +02:00

monitoring

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

nodes

fix(nodes): clear pending backend ops behind offline/draining nodes

2026-06-07 22:37:24 +00:00

quantization

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

routing

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

skills

refactor(agents): bump skillserver, drop redundant Name from list_skills output (#9916)

2026-05-21 14:45:53 +02:00

storage

feat: track files being staged (#9275)

2026-04-08 14:33:58 +02:00

testutil

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

voicerecognition

feat: voice recognition (#9500)

2026-04-23 12:07:14 +02:00

worker

feat(distributed): enforce registration token for worker file transfer (#10183)

2026-06-05 14:34:28 +02:00