Ettore Di Giacinto 532e3a4272 fix(worker): stop backends without Free on model.unload ...

model.unload calls Free over gRPC and keeps the backend process alive.
llama-cpp does not implement Free, so the call answers Unimplemented,
nothing is released, and the next backend.install for the same replica
reuses the live process. The second LoadModel on that process dies a
second after the slots are initialized, and the controller sees EOF or
Unavailable until the following install starts a fresh process.

When Free answers Unimplemented, stop the process after the unload so
the next install starts a clean one. Backends that implement Free keep
their process, so reloads stay cheap for them.

Assisted-by: Claude Code:claude-sonnet-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-11-03 09:40:46 +00:00

..

addr_test.go

fix(model): make backend shutdown model-scoped (#10865)

2026-07-19 08:43:17 +02:00

auth_required_test.go

feat(distributed): enforce registration token for worker file transfer (#10183)

2026-06-05 14:34:28 +02:00

backend_delete_test.go

fix(worker): reap deleted backends and stop models that live on a worker (#10956)

2026-07-20 01:09:22 +02:00

backend_reinstall_cwd_test.go

fix(worker): never reuse a backend process whose directory a reinstall replaced (#11029)

2026-07-22 17:29:59 +02:00

concurrency_test.go

fix(distributed): split NATS backend.upgrade off install + dedup loads (#9717)

2026-05-08 16:24:54 +02:00

config.go

feat(backends): --disable-backend-install disables backend downloads. (#12754)

2026-10-22 17:58:53 +02:00

control_nats_test.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

control_nats.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

control_server.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

development_preference_test.go

fix(backends): prefer installed development builds (#12782)

2026-10-19 22:58:38 +02:00

env_test.go

fix(proxy): propagate model env and accept direct keys (#12940)

2026-10-27 10:27:45 +01:00

ephemeral_capacity_test.go

fix(worker): resolve temporary paths in tests (#11944)

2026-09-09 08:51:09 +02:00

ephemeral_capacity.go

fix(distributed): bound ephemeral staging (#11924)

2026-09-08 18:13:40 +02:00

ephemeral_cleanup_test.go

fix(worker): resolve temporary paths in tests (#11944)

2026-09-09 08:51:09 +02:00

ephemeral_cleanup.go

fix(distributed): bound ephemeral staging (#11924)

2026-09-08 18:13:40 +02:00

file_staging_release_test.go

refactor(distributed): put the NATS-only paths behind interfaces (#12395)

2026-10-02 23:58:41 +02:00

file_staging_verbs_test.go

refactor(distributed): put the NATS-only paths behind interfaces (#12395)

2026-10-02 23:58:41 +02:00

file_staging.go

refactor(distributed): put the NATS-only paths behind interfaces (#12395)

2026-10-02 23:58:41 +02:00

free_timeout_test.go

feat(motion): add GEM-X backend and duplex streaming API

2026-10-13 08:27:24 +00:00

install_disabled_test.go

feat(backends): --disable-backend-install disables backend downloads. (#12754)

2026-10-22 17:58:53 +02:00

install.go

fix(proxy): propagate model env and accept direct keys (#12940)

2026-10-27 10:27:45 +01:00

lifecycle.go

fix(worker): stop backends without Free on model.unload

2026-11-03 09:40:46 +00:00

loaded_backend_addresses_test.go

fix(distributed): survive a slow control-plane database (#11837)

2026-09-02 12:37:12 +02:00

model_stop_test.go

feat(motion): add GEM-X backend and duplex streaming API

2026-10-13 08:27:24 +00:00

models_running_test.go

fix(distributed): reaper reaps live backends, ghost model stubs, in_flight leak, sidecar staging runaway (#11142)

2026-07-27 18:36:31 +02:00

models_running.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

nats_connect_test.go

feat(distributed): Add NATS JWT authentication and TLS/mTLS options (#10159)

2026-06-03 19:43:56 +02:00

nats_connect.go

feat(distributed): Add NATS JWT authentication and TLS/mTLS options (#10159)

2026-06-03 19:43:56 +02:00

operations_orphan_test.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

operations_test.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

operations.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

port_allocator_test.go

fix(worker): bound the gRPC port allocator and stop leaking dead backends' ports (#10968)

2026-07-19 23:56:37 +00:00

port_quarantine_test.go

fix(worker): bound the gRPC port allocator and stop leaking dead backends' ports (#10968)

2026-07-19 23:56:37 +00:00

prefetch_test.go

feat(worker): add LOCALAI_PREFETCH_MODELS for boot-time gallery prefetch (#10108)

2026-05-31 12:22:45 +02:00

prefetch.go

feat(worker): add LOCALAI_PREFETCH_MODELS for boot-time gallery prefetch (#10108)

2026-05-31 12:22:45 +02:00

process_helpers.go

fix(distributed): split NATS backend.upgrade off install + dedup loads (#9717)

2026-05-08 16:24:54 +02:00

process_ledger_unix.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

process_ledger_windows.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

process_ledger.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

registration_test.go

feat(nodes): add fleet operations dashboard (#12046)

2026-09-15 00:57:14 +02:00

registration.go

fix(distributed): bound, stop and cancel model loads with leases and worker operations (#12524)

2026-10-07 16:59:56 +02:00

replica_test.go

refactor(distributed): put the NATS-only paths behind interfaces (#12395)

2026-10-02 23:58:41 +02:00

reply.go

fix(distributed): split NATS backend.upgrade off install + dedup loads (#9717)

2026-05-08 16:24:54 +02:00

supervisor.go

fix(proxy): propagate model env and accept direct keys (#12940)

2026-10-27 10:27:45 +01:00

unload_restart_test.go

fix(worker): stop backends without Free on model.unload

2026-11-03 09:40:46 +00:00

unload_targets_test.go

fix(distributed): free only the named model on model.unload (#12537)

2026-10-06 22:44:25 +02:00

worker_suite_test.go

fix(worker): resolve temporary paths in tests (#11944)

2026-09-09 08:51:09 +02:00

worker.go

feat(backends): --disable-backend-install disables backend downloads. (#12754)

2026-10-22 17:58:53 +02:00