mirror of
https://github.com/mudler/LocalAI.git
synced 2026-07-31 10:28:43 -04:00
40d35c0385
* docs: fix CPU image tag (latest, not latest-cpu) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: use canonical localai/localai registry in models guide Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: replace dead llama-stable backend with llama-cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: correct mitm-proxy intercept config and redaction tier Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fix text-to-audio endpoint and broken notice block Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fix VAD example, stale FAQ, broken link, CLI list, whats-new dump Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: render advanced/reference section indexes (consolidate _index) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove duplicate getting-started build/kubernetes pages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fold container image reference into installation/containers Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove stale advanced fine-tuning page (superseded by features/fine-tuning) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fold distribution/longcat/sound pages into their parents Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: make getting-started index accurate and complete Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: carry one concrete model through the getting-started path Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add end-to-end 'build your first agent' walkthrough Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add runtime errors reference; consolidate troubleshooting from FAQ Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add agent actions catalog Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: agent-scoped MCP, skills walkthrough, agentic disambiguation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add concrete gallery install lines to media feature pages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: merge installation into getting-started (URLs preserved via aliases) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add Operations section; move operator pages and P2P API reference Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: journey-ordered top nav and grouped feature sections Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add docs-with-code process gate (PR template + agent instructions) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove em/en dashes from documentation prose Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
113 lines
3.0 KiB
Markdown
113 lines
3.0 KiB
Markdown
---
|
|
weight: 5
|
|
title: "Advanced"
|
|
description: "Advanced usage"
|
|
type: chapter
|
|
icon: settings
|
|
lead: ""
|
|
date: 2020-10-06T08:49:15+00:00
|
|
lastmod: 2020-10-06T08:49:15+00:00
|
|
draft: false
|
|
images: []
|
|
---
|
|
|
|
## Overview
|
|
|
|
The **Advanced** section covers in-depth topics for users who want to fully leverage LocalAI's capabilities beyond basic usage. These pages are designed for developers, DevOps engineers, and power users who need fine-grained control over model configuration, system resources, and deployment infrastructure.
|
|
|
|
### Who Should Read This Section
|
|
|
|
- **Developers** integrating LocalAI into applications
|
|
- **DevOps Engineers** deploying LocalAI in production
|
|
- **ML Engineers** optimizing model performance
|
|
- **System Administrators** managing multi-user installations
|
|
|
|
---
|
|
|
|
## Topics
|
|
|
|
### 🚀 [Advanced Usage](advanced-usage.md)
|
|
Comprehensive guide to advanced LocalAI features including multi-modal inference, custom backends, and extended API capabilities.
|
|
|
|
**Key topics:**
|
|
- Multi-modal model support
|
|
- Custom backend integration
|
|
- Advanced API endpoints
|
|
- Request/response customization
|
|
|
|
**Recommended for:** Developers extending LocalAI functionality
|
|
|
|
---
|
|
|
|
### 🎯 [Model Configuration](model-configuration.md)
|
|
Complete reference for model configuration files, parameters, and optimization settings.
|
|
|
|
**Key topics:**
|
|
- Configuration file format
|
|
- Model-specific parameters
|
|
- Quantization settings
|
|
- Performance tuning
|
|
|
|
**Recommended for:** ML engineers optimizing model behavior
|
|
|
|
---
|
|
|
|
### 🔒 [Reverse Proxy & TLS](reverse-proxy-tls.md)
|
|
Complete guide to securing LocalAI deployments with reverse proxies and TLS certificates.
|
|
|
|
**Key topics:**
|
|
- Nginx/Apache configuration
|
|
- TLS certificate setup
|
|
- Authentication layers
|
|
- Production hardening
|
|
|
|
**Recommended for:** DevOps engineers deploying to production
|
|
|
|
---
|
|
|
|
### 💾 [VRAM Management](vram-management.md)
|
|
Advanced techniques for managing GPU memory and optimizing parallel inference.
|
|
|
|
**Key topics:**
|
|
- GPU memory allocation
|
|
- Multi-model loading
|
|
- Batch processing
|
|
- Resource scheduling
|
|
|
|
**Recommended for:** Users running multiple models on limited hardware
|
|
|
|
---
|
|
|
|
## Quick Links
|
|
|
|
| Task | Documentation |
|
|
|------|---------------|
|
|
| Configure a model | [Model Configuration](model-configuration.md) |
|
|
| Deploy securely | [Reverse Proxy & TLS](reverse-proxy-tls.md) |
|
|
| Optimize VRAM usage | [VRAM Management](vram-management.md) |
|
|
| Extend functionality | [Advanced Usage](advanced-usage.md) |
|
|
|
|
---
|
|
|
|
## Prerequisites
|
|
|
|
Before diving into advanced topics, ensure you have:
|
|
|
|
1. ✅ Completed the [Getting Started](../getting-started/) guide
|
|
2. ✅ Successfully run LocalAI with a basic model
|
|
3. ✅ Basic understanding of command-line interfaces
|
|
4. ✅ Familiarity with YAML configuration (for most topics)
|
|
|
|
---
|
|
|
|
## Related Sections
|
|
|
|
- 📚 [Reference](../reference/) - API documentation and command reference
|
|
- 🔌 [Installation](../installation/) - Deployment options and requirements
|
|
- ⭐ [Features](../features/) - Overview of LocalAI capabilities
|
|
|
|
---
|
|
|
|
## Navigation
|
|
|
|
← [Getting Started](../getting-started/) | [Reference](../reference/) → |