LocalAI [bot] 7637f8cf1b feat(distributed): declarative per-model scheduling via env/args (#10308) ...

* feat(distributed): add SpreadAll column and authoritative scheduling seeding

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(distributed): parse declarative model scheduling config (env/file)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(distributed): reconcile spread_all to one replica per matching node

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(distributed): wire LOCALAI_MODEL_SCHEDULING env/args and startup seeding

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(distributed): expose spread_all on the scheduling API endpoint

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(distributed): add spread-to-all-nodes mode to the scheduling UI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs(distributed): document LOCALAI_MODEL_SCHEDULING env/args

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs(distributed): clarify replica modes and all-nodes spread in scheduling config

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-13 18:31:06 +02:00

..

agent_jobs.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

application_suite_test.go

feat(branding): admin-configurable instance name, tagline, and assets (#9635)

2026-05-02 15:51:36 +02:00

application.go

fix(application): stop backend processes synchronously on shutdown (#10058)

2026-05-29 11:40:43 +02:00

config_file_watcher.go

feat(ux): backend management enhancement (#9325)

2026-04-12 00:35:22 +02:00

distributed.go

feat(distributed): declarative per-model scheduling via env/args (#10308)

2026-06-13 18:31:06 +02:00

mitm_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

mitm.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

p2p.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

router_factories_test.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

router_factories.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

runtime_settings_branding_test.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

startup.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

upgrade_checker.go

fix: distributed backend reinstall/upgrade UI stuck on 'reinstalling' (#10214)

2026-06-08 10:03:02 +02:00

watchdog_test.go

feat(concurrency-groups): per-model exclusive groups for backend loading (#9662)

2026-05-05 08:42:50 +02:00

watchdog.go

feat(concurrency-groups): per-model exclusive groups for backend loading (#9662)

2026-05-05 08:42:50 +02:00