aea954a482
Reframe the README hero and docs (homepage, overview, FAQ) around the composable architecture: a small core, with backends built as dedicated gRPC services around best-in-class engines, shipped as separate OCI images and pulled on demand. Lead from strength: drop the "36+ backends" kitchen-sink framing and the "All-in-One Complete AI Stack" / "single binary that gives you everything" lines that read as a monolith. - README: small-core differentiator; composable + open/extensible bullets - _index.md: composable tagline; install only what you use - overview.md: core vs on-demand backends; gRPC/OCI mechanics as benefits; bring-your-own model and backend - faq.md: "Do I need to install all the backends?" and "Can I bring my own model or backend?" Assisted-by: Claude:claude-opus-4-8 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
3.8 KiB
+++ title = "LocalAI" description = "The free, OpenAI and Anthropic alternative. A small, composable AI stack: run any model locally and install only what you use." type = "home" +++
The free, OpenAI and Anthropic alternative. A small, composable AI stack. - Run powerful language models, autonomous agents, and document intelligence locally on your hardware. A lean core that pulls model backends on demand, so you install only what you use.
No cloud, no limits, no compromise.
{{% notice tip %}} ⭐ Star us on GitHub - 40k+ stars and growing!
Drop-in replacement for OpenAI API - modular suite of tools that work seamlessly together or independently.
Start with LocalAI's OpenAI-compatible API, extend with LocalAGI's autonomous agents, and enhance with LocalRecall's semantic search - all running locally on your hardware.
Open Source MIT Licensed. {{% /notice %}}
Why Choose LocalAI?
OpenAI API Compatible - Run AI models locally with our modular ecosystem. From language models to autonomous agents and semantic search, build your complete AI stack without the cloud.
Key Features
- LLM Inferencing: LocalAI is a free, Open Source OpenAI alternative. Run LLMs, generate images, audio and more locally with consumer grade hardware.
- Agentic-first: Extend LocalAI with LocalAGI, an autonomous AI agent platform that runs locally, no coding required. Build and deploy autonomous agents with ease.
- Memory and Knowledge base: Extend LocalAI with LocalRecall, A local rest api for semantic search and memory management. Perfect for AI applications.
- OpenAI Compatible: Drop-in replacement for OpenAI API. Compatible with existing applications and libraries.
- No GPU Required: Run on consumer grade hardware. No need for expensive GPUs or cloud services.
- Multiple Models: Support for various model families including LLMs, image generation, and audio models. Supports multiple backends for inferencing.
- Privacy Focused: Keep your data local. No data leaves your machine, ensuring complete privacy.
- Easy Setup: Simple installation and configuration. Get started in minutes with Binaries installation, Docker, Podman, Kubernetes or local installation.
- Community Driven: Active community support and regular updates. Contribute and help shape the future of LocalAI.
Quick Start
Docker is the recommended installation method for most users:
docker run -p 8080:8080 --name local-ai -ti localai/localai:latest
For complete installation instructions, see the Installation guide.
Get Started
- Install LocalAI - Choose your installation method (Docker recommended)
- Quickstart Guide - Get started quickly after installation
- Install and Run Models - Learn how to work with AI models
- Try It Out - Explore examples and use cases