50cd897719
* docs: refresh LocalAI homepage Reframe the homepage around LocalAI's modular multimodal runtime, native inference engines, deployment range, and built-in platform capabilities. Remove the outdated video in favor of current product visuals and clearer paths into the documentation. Assisted-by: Codex:gpt-5 * docs: give homepage a full-width canvas Let the product homepage opt out of Relearn's persistent sidebar and duplicate title while preserving the documentation shell on interior pages. Tighten the responsive bounds for narrow screens. Assisted-by: Codex:gpt-5 * docs: fit homepage to the Relearn content flow Remove the full-width shell exception and use a single-column homepage inside the standard documentation layout. This avoids competing scroll containers and the compressed split hero. Assisted-by: Codex:gpt-5 * docs: hide homepage scroll rail Preserve Relearn's content scrolling while removing the visible scrollbar beside the landing-page hero. Assisted-by: Codex:gpt-5 * docs: contain homepage sections within docs column Prevent landing-page headings, figures, and section grids from widening Relearn's content pane or exposing overflow rails. Assisted-by: Codex:gpt-5 * docs: remove nested homepage scrollbars Wrap the quick-start command within its column and suppress component-level scrollbar tracks across the landing page. Assisted-by: Codex:gpt-5 * docs: remove outdated gallery screenshot Drop the stale Model Gallery image from the homepage until a current product visual is available. Assisted-by: Codex:gpt-5 * docs: fix homepage architecture link Point the homepage CTA at the generated reference/architecture route. Assisted-by: Codex:gpt-5 --------- Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
5.8 KiB
+++ title = "LocalAI" description = "The open, modular AI runtime. Run text, vision, voice, image, video, agents, and more on hardware you control." type = "home" +++
Open source · MIT licensed
One runtime.
Every kind of AI.
Your hardware.
LocalAI runs text, vision, speech, sound, images, video, embeddings, reranking, and autonomous agents behind one modular stack—from a CPU laptop to a distributed GPU cluster.
The runtime, not just the endpoint.
Bring the model. Choose the engine. Keep control.
A small core, not a giant bundle.
Backends arrive when the model needs them.
LocalAI keeps the core lean. Each backend wraps a best-in-class engine—llama.cpp, vLLM, SGLang, MLX, whisper.cpp, diffusion engines, and many more—as an isolated service pulled on demand.
- Install, update, or remove engines independently.
- Mix CPU, NVIDIA, AMD, Intel, Apple Silicon, Vulkan, and Jetson.
- Build your own backend in any language through an open gRPC contract.
We integrate the best engines. We build new ones, too.
Inference work that moves the open ecosystem forward.
The LocalAI team develops native C, C++, Rust, and GGML engines when the available stack is too heavy, too closed, or simply does not exist yet.
See the engines we maintain ↗Start on one machine. Keep going.
The same runtime from workstation to private AI fabric.
Run useful models locally, including CPU-only setups.
Add authentication, API keys, roles, quotas, and usage visibility.
Route across workers, fit models across devices, and scale with demand.
More than inference
A complete local AI control plane.
Create agents with MCP tools, skills, memory, RAG, citations, and streamed execution from the UI or API.
Build interruptible voice experiences with WebRTC, streaming STT, LLM output, and TTS.
Keep data on your infrastructure and add PII analysis, redaction, policy middleware, and audit visibility.
Discover capabilities, import models, fine-tune, quantize, route, and monitor them in one place.
One command to begin
Run your first local AI stack.
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest