LocalAI/docs/content/features/_index.en.md

+++ disableToc = false title = "Features" weight = 4 icon = "lightbulb" type = "chapter" url = "/features/" +++

LocalAI provides a comprehensive set of features for running AI models locally. The pages in this section are grouped by capability, and the left navigation is ordered to match these groups.

Text

• [Text Generation]({{% relref "features/text-generation" %}}) - Generate text with GPT-compatible models using various backends.
• [OpenAI Functions and tools]({{% relref "features/openai-functions" %}}) - Use function calling and the tools API with local models.
• [Constrained Grammars]({{% relref "features/constrained_grammars" %}}) - Control model output format with BNF grammars.
• [Interleaved thinking]({{% relref "features/interleaved-thinking" %}}) - Reasoning models that interleave thought and output.
• [Model aliases]({{% relref "features/model-aliases" %}}) - Expose one model under several names.
• [API discovery]({{% relref "features/api-discovery" %}}) - How LocalAI advertises its capability surface.

Agents

• [Agents]({{% relref "features/agents" %}}) - Autonomous AI agents with tools, knowledge base, and skills.
• [Agent Actions]({{% relref "features/agent-actions" %}}) - The catalog of actions an agent can run.
• [Model Context Protocol (MCP)]({{% relref "features/mcp" %}}) - Give a model external tools over MCP.
• [LocalAI Assistant]({{% relref "features/localai-assistant" %}}) - Chat to administer your LocalAI instance.

Audio

• [Audio to text]({{% relref "features/audio-to-text" %}}) - Transcribe audio to text.
• [Text to audio]({{% relref "features/text-to-audio" %}}) - Generate speech, music, and sound effects from text.
• [Audio classification]({{% relref "features/audio-classification" %}}) - Classify sounds and audio events.
• [Audio diarization]({{% relref "features/audio-diarization" %}}) - Separate speakers in an audio stream.
• [Audio transform]({{% relref "features/audio-transform" %}}) - Transform and process audio.
• [Voice Activity Detection]({{% relref "features/voice-activity-detection" %}}) - Detect speech segments in audio data.
• [Voice recognition]({{% relref "features/voice-recognition" %}}) - Identify speakers by voice.
• [Realtime API]({{% relref "features/openai-realtime" %}}) - Low-latency multi-modal conversations (voice and text) over WebSocket.

Vision

• [GPT Vision]({{% relref "features/gpt-vision" %}}) - Analyze and understand images with vision-language models.
• [Object detection]({{% relref "features/object-detection" %}}) - Detect and locate objects in images.
• [Face recognition]({{% relref "features/face-recognition" %}}) - Recognize faces in images.

Image and Video

• [Image Generation]({{% relref "features/image-generation" %}}) - Create images with Stable Diffusion and other diffusion models.
• [Video Generation]({{% relref "features/video-generation" %}}) - Generate videos from text, image, or audio conditioning, including LongCat and avatar workflows.

Retrieval

• [Embeddings]({{% relref "features/embeddings" %}}) - Generate vector embeddings for semantic search and RAG applications.
• [Reranker]({{% relref "features/reranker" %}}) - Improve retrieval accuracy with cross-encoder models.
• [Stores]({{% relref "features/stores" %}}) - Vector similarity search for embeddings.

Distributed and acceleration

• [Distributed inference]({{% relref "features/distributed_inferencing" %}}) - Scale inference across multiple nodes (P2P federation or production distributed mode).
• [Distributed mode]({{% relref "features/distributed-mode" %}}) - The production distributed deployment.
• [MLX distributed]({{% relref "features/mlx-distributed" %}}) - Distributed inference on Apple Silicon with MLX.
• [GPU Acceleration]({{% relref "features/GPU-acceleration" %}}) - Optimize performance with GPU support.

Platform and model management

• [Backends]({{% relref "features/backends" %}}) - Available backends and how to manage them.
• [Model Gallery]({{% relref "features/model-gallery" %}}) - Browse and install pre-configured models.
• [Runtime Settings]({{% relref "features/runtime-settings" %}}) - Configure application settings via the web UI without restarting.
• [Quantization]({{% relref "features/quantization" %}}) - Quantize models for smaller memory footprint.
• [Fine-tuning]({{% relref "features/fine-tuning" %}}) - Fine-tune models on your own data.
• [Authentication]({{% relref "features/authentication" %}}) - Protect the API with keys.

For operator-facing runtime, proxy, and monitoring concerns (middleware, cloud and MITM proxies, backend monitor), see the [Operations]({{% relref "operations" %}}) section.

Getting Started

To start using these features, make sure you have [LocalAI installed]({{% relref "getting-started/install" %}}) and have [downloaded some models]({{% relref "getting-started/models" %}}). Then explore the feature pages above to learn how to use each capability.