mirror of
https://github.com/mudler/LocalAI.git
synced 2026-04-02 06:04:09 -04:00
59108fbe32
* feat: add distributed mode (experimental) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix data races, mutexes, transactions Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactorings Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fixups Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix events and tool stream in agent chat Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * use ginkgo Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(cron): compute correctly time boundaries avoiding re-triggering Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * enhancements, refactorings Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * do not flood of healthy checks Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * do not list obvious backends as text backends Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * tests fixups Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring and consolidation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Drop redundant healthcheck Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * enhancements, refactorings Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
49 lines
2.9 KiB
Markdown
49 lines
2.9 KiB
Markdown
+++
|
|
disableToc = false
|
|
title = "Features"
|
|
weight = 8
|
|
icon = "lightbulb"
|
|
type = "chapter"
|
|
url = "/features/"
|
|
+++
|
|
|
|
LocalAI provides a comprehensive set of features for running AI models locally. This section covers all the capabilities and functionalities available in LocalAI.
|
|
|
|
## Core Features
|
|
|
|
- **[Text Generation](text-generation/)** - Generate text with GPT-compatible models using various backends
|
|
- **[Image Generation](image-generation/)** - Create images with Stable Diffusion and other diffusion models
|
|
- **[Audio Processing](audio-to-text/)** - Transcribe audio to text and generate speech from text
|
|
- **[Text to Audio](text-to-audio/)** - Generate speech from text with TTS models
|
|
- **[Sound Generation](sound-generation/)** - Generate music and sound effects from text descriptions
|
|
- **[Voice Activity Detection](voice-activity-detection/)** - Detect speech segments in audio data
|
|
- **[Video Generation](video-generation/)** - Generate videos from text prompts and reference images
|
|
- **[Embeddings](embeddings/)** - Generate vector embeddings for semantic search and RAG applications
|
|
- **[GPT Vision](gpt-vision/)** - Analyze and understand images with vision-language models
|
|
|
|
## Advanced Features
|
|
|
|
- **[OpenAI Functions](openai-functions/)** - Use function calling and tools API with local models
|
|
- **[Realtime API](openai-realtime/)** - Low-latency multi-modal conversations (voice+text) over WebSocket
|
|
- **[Constrained Grammars](constrained_grammars/)** - Control model output format with BNF grammars
|
|
- **[GPU Acceleration](GPU-acceleration/)** - Optimize performance with GPU support
|
|
- **[Distributed Inference](distributed_inferencing/)** - Scale inference across multiple nodes
|
|
- **[Distributed Mode](distributed-mode/)** - Horizontal scaling with PostgreSQL, NATS, and remote backend nodes
|
|
- **[P2P API](p2p/)** - Monitor and manage P2P worker and federated nodes
|
|
- **[Model Context Protocol (MCP)](mcp/)** - Enable agentic capabilities with MCP integration
|
|
- **[Agents](agents/)** - Autonomous AI agents with tools, knowledge base, and skills
|
|
|
|
## Specialized Features
|
|
|
|
- **[Object Detection](object-detection/)** - Detect and locate objects in images
|
|
- **[Reranker](reranker/)** - Improve retrieval accuracy with cross-encoder models
|
|
- **[Stores](stores/)** - Vector similarity search for embeddings
|
|
- **[Model Gallery](model-gallery/)** - Browse and install pre-configured models
|
|
- **[Backends](backends/)** - Learn about available backends and how to manage them
|
|
- **[Backend Monitor](backend-monitor/)** - Monitor backend status and resource usage
|
|
- **[Runtime Settings](runtime-settings/)** - Configure application settings via web UI without restarting
|
|
|
|
## Getting Started
|
|
|
|
To start using these features, make sure you have [LocalAI installed](/installation/) and have [downloaded some models](/getting-started/models/). Then explore the feature pages above to learn how to use each capability.
|