mirror of
https://github.com/mudler/LocalAI.git
synced 2026-07-30 09:57:57 -04:00
40d35c0385
* docs: fix CPU image tag (latest, not latest-cpu) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: use canonical localai/localai registry in models guide Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: replace dead llama-stable backend with llama-cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: correct mitm-proxy intercept config and redaction tier Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fix text-to-audio endpoint and broken notice block Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fix VAD example, stale FAQ, broken link, CLI list, whats-new dump Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: render advanced/reference section indexes (consolidate _index) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove duplicate getting-started build/kubernetes pages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fold container image reference into installation/containers Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove stale advanced fine-tuning page (superseded by features/fine-tuning) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fold distribution/longcat/sound pages into their parents Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: make getting-started index accurate and complete Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: carry one concrete model through the getting-started path Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add end-to-end 'build your first agent' walkthrough Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add runtime errors reference; consolidate troubleshooting from FAQ Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add agent actions catalog Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: agent-scoped MCP, skills walkthrough, agentic disambiguation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add concrete gallery install lines to media feature pages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: merge installation into getting-started (URLs preserved via aliases) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add Operations section; move operator pages and P2P API reference Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: journey-ordered top nav and grouped feature sections Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add docs-with-code process gate (PR template + agent instructions) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove em/en dashes from documentation prose Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
3.0 KiB
3.0 KiB
weight, title, description, type, icon, lead, date, lastmod, draft, images
| weight | title | description | type | icon | lead | date | lastmod | draft | images |
|---|---|---|---|---|---|---|---|---|---|
| 5 | Advanced | Advanced usage | chapter | settings | 2020-10-06T08:49:15+00:00 | 2020-10-06T08:49:15+00:00 | false |
Overview
The Advanced section covers in-depth topics for users who want to fully leverage LocalAI's capabilities beyond basic usage. These pages are designed for developers, DevOps engineers, and power users who need fine-grained control over model configuration, system resources, and deployment infrastructure.
Who Should Read This Section
- Developers integrating LocalAI into applications
- DevOps Engineers deploying LocalAI in production
- ML Engineers optimizing model performance
- System Administrators managing multi-user installations
Topics
🚀 Advanced Usage
Comprehensive guide to advanced LocalAI features including multi-modal inference, custom backends, and extended API capabilities.
Key topics:
- Multi-modal model support
- Custom backend integration
- Advanced API endpoints
- Request/response customization
Recommended for: Developers extending LocalAI functionality
🎯 Model Configuration
Complete reference for model configuration files, parameters, and optimization settings.
Key topics:
- Configuration file format
- Model-specific parameters
- Quantization settings
- Performance tuning
Recommended for: ML engineers optimizing model behavior
🔒 Reverse Proxy & TLS
Complete guide to securing LocalAI deployments with reverse proxies and TLS certificates.
Key topics:
- Nginx/Apache configuration
- TLS certificate setup
- Authentication layers
- Production hardening
Recommended for: DevOps engineers deploying to production
💾 VRAM Management
Advanced techniques for managing GPU memory and optimizing parallel inference.
Key topics:
- GPU memory allocation
- Multi-model loading
- Batch processing
- Resource scheduling
Recommended for: Users running multiple models on limited hardware
Quick Links
| Task | Documentation |
|---|---|
| Configure a model | Model Configuration |
| Deploy securely | Reverse Proxy & TLS |
| Optimize VRAM usage | VRAM Management |
| Extend functionality | Advanced Usage |
Prerequisites
Before diving into advanced topics, ensure you have:
- ✅ Completed the Getting Started guide
- ✅ Successfully run LocalAI with a basic model
- ✅ Basic understanding of command-line interfaces
- ✅ Familiarity with YAML configuration (for most topics)
Related Sections
- 📚 Reference - API documentation and command reference
- 🔌 Installation - Deployment options and requirements
- ⭐ Features - Overview of LocalAI capabilities
Navigation
← Getting Started | Reference →