Ettore Di Giacinto 1af79c1b0f feat(model): add LookupNodeID for pure-store node ID reads ...

Adds ModelLoader.LookupNodeID, a hot-path-safe helper that returns the
distributed worker node ID stamped on a loaded model without touching
ml.mu or issuing a gRPC HealthCheck. Backed by a new storeMu RWMutex
that guards only the store reference, so the read never blocks behind a
HealthCheck-holding CheckIsLoaded.

Needed by the X-LocalAI-Node response-header middleware, which runs on
the response goroutine right before the first byte hits the client and
must never pay I/O for the lookup. The header value is best-effort
observability and stale reads are acceptable.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-7[1m]

2026-05-24 21:39:44 +00:00

..

backend_log_store_test.go

feat: react chat redesign (#9616)

2026-04-29 22:33:26 +02:00

backend_log_store.go

feat: react chat redesign (#9616)

2026-04-29 22:33:26 +02:00

connection_errors.go

fix(nodes): better detection if nodes goes down or model is not available (#9274)

2026-04-08 12:11:02 +02:00

connection_evicting_client.go

feat: wire transcription for llama.cpp, add streaming support (#9353)

2026-04-14 16:13:40 +02:00

filters.go

fix: make sure to close on errors (#7521)

2025-12-11 14:03:20 +01:00

initializers_retry_test.go

feat(concurrency-groups): per-model exclusive groups for backend loading (#9662)

2026-05-05 08:42:50 +02:00

initializers.go

fix(distributed): route per request across loaded replicas + cache probeHealth (#9968)

2026-05-24 08:15:27 +00:00

loader_options.go

feat: refactor build process, drop embedded backends (#5875)

2025-07-22 16:31:04 +02:00

loader_test.go

fix(nodes): better detection if nodes goes down or model is not available (#9274)

2026-04-08 12:11:02 +02:00

loader.go

feat(model): add LookupNodeID for pure-store node ID reads

2026-05-24 21:39:44 +00:00

lookup_node_id_test.go

feat(model): add LookupNodeID for pure-store node ID reads

2026-05-24 21:39:44 +00:00

model_suite_test.go

tests: add template tests (#2063)

2024-04-18 10:57:24 +02:00

model.go

feat(distributed): surface picked node ID via X-LocalAI-Node header

2026-05-24 20:14:02 +00:00

process.go

feat: Log backend exit code (#9581)

2026-04-27 14:19:18 +02:00

store_test.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

store.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

watchdog_options_test.go

chore: fixup tests with defaults from constants

2025-12-16 21:26:55 +00:00

watchdog_options.go

feat: disable force eviction (#7725)

2025-12-25 14:26:18 +01:00

watchdog_test.go

feat(concurrency-groups): per-model exclusive groups for backend loading (#9662)

2026-05-05 08:42:50 +02:00

watchdog.go

feat(concurrency-groups): per-model exclusive groups for backend loading (#9662)

2026-05-05 08:42:50 +02:00