mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-29 01:28:43 -04:00
Offer Q5_K_M, Q6_K, and Q8_0 alongside the existing Q4_K_M build. Pin all four assets and correct the gallery description. Document direct installation of a quantization variant. Assisted-by: Codex:gpt-6