LocalAI · VRAM

Load, evict, reuse

LRU

evict

Least-recently-used eviction keeps the hottest models warm within your VRAM budget.

localai.io/advanced/vram-management