LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2026-04-01 05:36:49 -04:00

Files

LocalAI [bot] f73a158153 docs: Document GPU auto-fit mode limitations and trade-offs (closes #8562 ) (#8954 )

* docs: Add documentation about GPU auto-fit mode limitations (closes #8562)

- Document the default gpu_layers behavior (9999999) that disables auto-fit
- Explain the trade-off between auto-fit and VRAM threshold unloading
- Add recommendations for users who want to enable gpu_layers: -1
- Note known issues with tensor_buft_override buffer errors
- Link to issue #8562 for future improvements

Signed-off-by: team-coding-agent-1 <team-coding-agent-1@localai.dev>

* Apply suggestion from @mudler

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: team-coding-agent-1 <team-coding-agent-1@localai.dev>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Co-authored-by: team-coding-agent-1 <team-coding-agent-1@localai.dev>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

2026-03-12 13:35:31 +01:00

advanced

docs: Document GPU auto-fit mode limitations and trade-offs (closes #8562 ) (#8954 )

2026-03-12 13:35:31 +01:00

features

feat(ui): MCP Apps, mcp streaming and client-side support (#8947 )

2026-03-11 07:30:49 +01:00

getting-started

feat: Create comprehensive troubleshooting guide (M1 task) (#8856 )

2026-03-08 21:58:32 +01:00

installation

docs: add CDI driver config for NVIDIA GPU in containers (fix #8108 ) (#8677 )