LocalAI · Distributed Mode

One control plane, many workers

SCALE

out

Stateless frontends, a shared NATS/Postgres plane, and generic workers running per-model backends.

localai.io/features/distributed-mode