mirror of
https://github.com/mudler/LocalAI.git
synced 2026-06-07 08:16:53 -04:00
aea954a482
Reframe the README hero and docs (homepage, overview, FAQ) around the composable architecture: a small core, with backends built as dedicated gRPC services around best-in-class engines, shipped as separate OCI images and pulled on demand. Lead from strength: drop the "36+ backends" kitchen-sink framing and the "All-in-One Complete AI Stack" / "single binary that gives you everything" lines that read as a monolith. - README: small-core differentiator; composable + open/extensible bullets - _index.md: composable tagline; install only what you use - overview.md: core vs on-demand backends; gRPC/OCI mechanics as benefits; bring-your-own model and backend - faq.md: "Do I need to install all the backends?" and "Can I bring my own model or backend?" Assisted-by: Claude:claude-opus-4-8 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
64 lines
3.8 KiB
Markdown
64 lines
3.8 KiB
Markdown
+++
|
|
title = "LocalAI"
|
|
description = "The free, OpenAI and Anthropic alternative. A small, composable AI stack: run any model locally and install only what you use."
|
|
type = "home"
|
|
+++
|
|
|
|
**The free, OpenAI and Anthropic alternative. A small, composable AI stack.** - Run powerful language models, autonomous agents, and document intelligence **locally** on your hardware. A lean core that pulls model backends on demand, so you install only what you use.
|
|
|
|
**No cloud, no limits, no compromise.**
|
|
|
|
{{% notice tip %}}
|
|
**[⭐ Star us on GitHub](https://github.com/mudler/LocalAI)** - 40k+ stars and growing!
|
|
|
|
**Drop-in replacement for OpenAI API** - modular suite of tools that work seamlessly together or independently.
|
|
|
|
Start with **[LocalAI](https://localai.io)**'s OpenAI-compatible API, extend with **[LocalAGI](https://github.com/mudler/LocalAGI)**'s autonomous agents, and enhance with **[LocalRecall](https://github.com/mudler/LocalRecall)**'s semantic search - all running locally on your hardware.
|
|
|
|
**Open Source** MIT Licensed.
|
|
{{% /notice %}}
|
|
|
|
<center><iframe width="560" height="315" src="https://www.youtube.com/embed/PDqYhB9nNHA?si=jUClTH7uuGMwMvFw" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe></center>
|
|
|
|
## Why Choose LocalAI?
|
|
|
|
**OpenAI API Compatible** - Run AI models locally with our modular ecosystem. From language models to autonomous agents and semantic search, build your complete AI stack without the cloud.
|
|
|
|
### Key Features
|
|
|
|
- **LLM Inferencing**: LocalAI is a free, **Open Source** OpenAI alternative. Run **LLMs**, generate **images**, **audio** and more **locally** with consumer grade hardware.
|
|
- **Agentic-first**: Extend LocalAI with LocalAGI, an autonomous AI agent platform that runs locally, no coding required. Build and deploy autonomous agents with ease.
|
|
- **Memory and Knowledge base**: Extend LocalAI with LocalRecall, A local rest api for semantic search and memory management. Perfect for AI applications.
|
|
- **OpenAI Compatible**: Drop-in replacement for OpenAI API. Compatible with existing applications and libraries.
|
|
- **No GPU Required**: Run on consumer grade hardware. No need for expensive GPUs or cloud services.
|
|
- **Multiple Models**: Support for various model families including LLMs, image generation, and audio models. Supports multiple backends for inferencing.
|
|
- **Privacy Focused**: Keep your data local. No data leaves your machine, ensuring complete privacy.
|
|
- **Easy Setup**: Simple installation and configuration. Get started in minutes with Binaries installation, Docker, Podman, Kubernetes or local installation.
|
|
- **Community Driven**: Active community support and regular updates. Contribute and help shape the future of LocalAI.
|
|
|
|
## Quick Start
|
|
|
|
**Docker is the recommended installation method** for most users:
|
|
|
|
```bash
|
|
docker run -p 8080:8080 --name local-ai -ti localai/localai:latest
|
|
```
|
|
|
|
For complete installation instructions, see the [Installation guide](/installation/).
|
|
|
|
## Get Started
|
|
|
|
1. **[Install LocalAI](/installation/)** - Choose your installation method (Docker recommended)
|
|
2. **[Quickstart Guide](/getting-started/quickstart/)** - Get started quickly after installation
|
|
3. **[Install and Run Models](/getting-started/models/)** - Learn how to work with AI models
|
|
4. **[Try It Out](/getting-started/try-it-out/)** - Explore examples and use cases
|
|
|
|
## Learn More
|
|
|
|
- [Explore available models](https://models.localai.io)
|
|
- [Model compatibility](/model-compatibility/)
|
|
- [Try out examples](https://github.com/mudler/LocalAI-examples)
|
|
- [Join the community](https://discord.gg/uJAeKSAGDy)
|
|
- [Check the LocalAI Github repository](https://github.com/mudler/LocalAI)
|
|
- [Check the LocalAGI Github repository](https://github.com/mudler/LocalAGI)
|