LocalAI · Architecture

One small core.
Backends you plug in.

ONLY WHAT

you actually run

Run a model and the right engine is pulled automatically.
Each backend is its own image, optimized for one job. Install nothing you don't use.

localai.io