Ettore Di Giacinto c9c1f20c93 fix(distributed/worker): run backend.install handler in a goroutine ...

NATS subscriptions deliver messages serially on a single per-subscription
goroutine. With a synchronous install handler, a multi-minute gallery
download would head-of-line-block every other install request to the
same worker — manifesting upstream as a 5-minute "nats: timeout" on
unrelated routine model loads.

The body now runs in its own goroutine, with a per-backend mutex
(lockBackend) protecting the gallery directory from concurrent operations
on the same backend. Different backend names install in parallel.

Backward-compat: req.Force=true is still honored here, so an older master
that hasn't been updated to send on backend.upgrade keeps working.

Assisted-by: Claude:claude-opus-4-7
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-05-08 08:24:04 +00:00

..

context

feat: Merge repeated log lines in the terminal (#9141)

2026-03-26 22:16:13 +01:00

worker

feat(vllm, distributed): tensor parallel distributed workers (#9612)

2026-05-06 00:22:50 +02:00

workerregistry

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

agent_test.go

feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)

2026-03-31 08:28:56 +02:00

agent_worker.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

agent.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

backends.go

feat: backend versioning, upgrade detection and auto-upgrade (#9315)

2026-04-11 22:31:15 +02:00

cli_suite_test.go

feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)

2026-03-31 08:28:56 +02:00

cli.go

feat: localai assistant chat modality (#9602)

2026-04-28 19:29:27 +02:00

completion_test.go

feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)

2026-03-31 08:28:56 +02:00

completion.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

deprecations.go

chore: Standardize CLI flag naming to kebab-case (M12) (#8912)

2026-03-09 22:15:39 +01:00

explorer.go

chore(refactor): move logging to common package based on slog (#7668)

2025-12-21 19:33:13 +01:00

federated.go

chore: Standardize CLI flag naming to kebab-case (M12) (#8912)

2026-03-09 22:15:39 +01:00

mcp_server.go

feat: localai assistant chat modality (#9602)

2026-04-28 19:29:27 +02:00

models.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

run.go

feat: localai assistant chat modality (#9602)

2026-04-28 19:29:27 +02:00

soundgeneration.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

transcript.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

tts.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

util.go

feat: improve CLI error messages with actionable guidance (#8880)

2026-04-21 11:53:26 +02:00

worker_addr_test.go

feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)

2026-03-31 08:28:56 +02:00

worker_concurrency_test.go

feat(distributed/worker): add per-backend mutex helper to backendSupervisor

2026-05-08 08:16:41 +00:00

worker_replica_test.go

fix(distributed): worker stopBackend/isRunning resolve bare modelID to replica keys

2026-04-27 21:43:15 +00:00

worker.go

fix(distributed/worker): run backend.install handler in a goroutine

2026-05-08 08:24:04 +00:00