From 29c49203b7f969a962e31ebd6ef3d39f4b83a5f1 Mon Sep 17 00:00:00 2001 From: Ettore Di Giacinto Date: Sun, 19 Jul 2026 21:15:00 +0000 Subject: [PATCH] gallery: group alternative builds of the same weights under variants Sweep the gallery for entries that are alternative builds of the same weights (different quantization, precision, or runtime format) and declare them as variants of a single parent row, so the listing offers one row per model instead of one row per quantization and the installer picks the largest build that this host can actually run. 41 families over 95 entries, turning 54 entries into variants. The parent is the bare-named entry wherever one exists, so nothing changes about what any existing entry installs. Ranking already selects the largest fitting build regardless of which entry is nominally the parent, so the parent only decides the pathological case where nothing fits. For the ten families that have no bare-named entry, the smallest build is the parent, since that is the one that has to install when nothing fits. Grouping was verified against the actual model filenames rather than the entry names alone. Different parameter sizes, languages, finetunes, and products that merely share a name prefix are left as separate rows: the qwen3.6 APEX and pi-tune finetunes, the DFlash and MTP speculative-decoding pairings, English-only versus multilingual Whisper, the QAT versus non-QAT Gemma 4 weights, and the abliterated FLUX build are all distinct models. Six parents define YAML anchors that other entries pull in with a merge key, which would have handed their variants to every merging child. For the two depth-anything anchors that would have made fourteen unrelated entries advertise the base model's builds as their own. All 26 merging children therefore carry an explicit empty variants list, which overrides the merged key and is equivalent to the key being absent. Assisted-by: Claude:claude-opus-4-8 Signed-off-by: Ettore Di Giacinto --- gallery/index.yaml | 119 +++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 119 insertions(+) diff --git a/gallery/index.yaml b/gallery/index.yaml index a91089bfb..3aeb87806 100644 --- a/gallery/index.yaml +++ b/gallery/index.yaml @@ -120,6 +120,9 @@ uri: huggingface://prism-ml/Bonsai-8B-gguf/Bonsai-8B-Q1_0.gguf - &ternary-bonsai-8b name: "ternary-bonsai-8b" + variants: + - model: ternary-bonsai-8b-q2-g64 + - model: ternary-bonsai-8b-pq2 url: "github:mudler/LocalAI/gallery/qwen3.yaml@master" license: apache-2.0 icon: https://huggingface.co/prism-ml/Ternary-Bonsai-8B-gguf/resolve/main/assets/bonsai-logo.svg @@ -156,6 +159,7 @@ uri: huggingface://prism-ml/Ternary-Bonsai-8B-gguf/Ternary-Bonsai-8B-Q2_0.gguf - !!merge <<: *ternary-bonsai-8b name: "ternary-bonsai-8b-q2-g64" + variants: [] description: | Ternary Bonsai 8B (PrismML), GGUF Q2_0 with group-64 packing (each FP16 scale shared across 64 weights instead of 128). Slightly larger (~2.31 GB) but matches llama.cpp's @@ -173,6 +177,7 @@ uri: huggingface://prism-ml/Ternary-Bonsai-8B-gguf/Ternary-Bonsai-8B-Q2_0_g64.gguf - !!merge <<: *ternary-bonsai-8b name: "ternary-bonsai-8b-pq2" + variants: [] description: | Ternary Bonsai 8B (PrismML), GGUF PQ2_0 (packed Q2_0) ternary variant (~2.18 GB). Same {-1, 0, +1} weight alphabet as Q2_0. Runs on LocalAI's `bonsai` backend. @@ -232,6 +237,9 @@ uri: huggingface://prism-ml/Bonsai-27B-gguf/Bonsai-27B-mmproj-Q8_0.gguf - &ternary-bonsai-27b name: "ternary-bonsai-27b" + variants: + - model: ternary-bonsai-27b-pq2 + - model: ternary-bonsai-27b-q2-g64 url: "github:mudler/LocalAI/gallery/qwen3.yaml@master" license: apache-2.0 icon: https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf/resolve/main/assets/bonsai-logo.svg @@ -274,6 +282,7 @@ uri: huggingface://prism-ml/Ternary-Bonsai-27B-gguf/Ternary-Bonsai-27B-mmproj-Q8_0.gguf - !!merge <<: *ternary-bonsai-27b name: "ternary-bonsai-27b-pq2" + variants: [] description: | Ternary Bonsai 27B (PrismML), GGUF PQ2_0 (packed Q2_0) ternary variant (~7.17 GB) with the 4-bit vision tower (mmproj) included. Runs on LocalAI's `bonsai` backend. @@ -295,6 +304,7 @@ uri: huggingface://prism-ml/Ternary-Bonsai-27B-gguf/Ternary-Bonsai-27B-mmproj-Q8_0.gguf - !!merge <<: *ternary-bonsai-27b name: "ternary-bonsai-27b-q2-g64" + variants: [] description: | Ternary Bonsai 27B (PrismML), GGUF Q2_0 with group-64 packing (~7.59 GB), matching llama.cpp's native 64-value Q2_0 block layout, with the 4-bit vision tower (mmproj) @@ -372,6 +382,10 @@ uri: https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF/resolve/main/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-Q4_K_M.gguf sha256: b1c3bf2995e96cb792a0031e4e1497a500e9244c68ba17c24a7e6edf1fc59019 - name: "deepseek-v4-flash" + variants: + - model: deepseek-v4-flash-q2 + - model: deepseek-v4-flash-q2-q4 + - model: deepseek-v4-flash-q4-ssd url: "github:mudler/LocalAI/gallery/virtual.yaml@master" urls: - https://huggingface.co/unsloth/DeepSeek-V4-Flash-GGUF @@ -1686,6 +1700,8 @@ sha256: 88956c71d20444d3ebf890e4495afed3257c6be877d4e82f0c26ce58e79b340f uri: https://huggingface.co/ReadyArt/Dark-Scarlett-v0.3-26B-A4B-GGUF/resolve/main/Dark-Scarlett-v0.3-26B-A4B-Q4_K_M.gguf - name: "qwopus3.6-27b-coder-mtp" + variants: + - model: qwopus3.6-27b-coder-mtp-nvfp4 url: "github:mudler/LocalAI/gallery/virtual.yaml@master" urls: - https://huggingface.co/Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF @@ -1723,6 +1739,8 @@ sha256: 32f7ea0600c07272547da401d460f8abbd980f3a57b69d6df87be0e2505e0b9c uri: https://huggingface.co/Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF/resolve/main/mmproj-F32.gguf - name: "gemma-4-26b-a4b-it-qat" + variants: + - model: gemma-4-26b-a4b-it-qat-q4_0 url: "github:mudler/LocalAI/gallery/virtual.yaml@master" urls: - https://huggingface.co/unsloth/gemma-4-26B-A4B-it-qat-GGUF @@ -2337,6 +2355,8 @@ sha256: 01b76572f80b7d2ebee80a27cb9c3699c26b04cae1c402eee7664fc17a4b5ce6 uri: https://huggingface.co/LocalAI-io/privacy-filter-multilingual-GGUF/resolve/main/privacy-filter-multilingual-f16.gguf - name: "privacy-filter-nemotron" + variants: + - model: privacy-filter-nemotron-q8 url: "github:mudler/LocalAI/gallery/virtual.yaml@master" icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png urls: @@ -2540,6 +2560,8 @@ sha256: f48daca405a1c768a9514e392c3955dcc4a9d66a5cf64cf45e064092b5f20ee4 uri: https://huggingface.co/Jackrong/Qwopus3.5-9B-Coder-MTP-GGUF/resolve/main/Qwopus3.5-9B-Coder-MTP-mmproj.gguf - name: "qwopus3.6-27b-v2-mtp" + variants: + - model: qwopus3.6-27b-v2-mtp-nvfp4 url: "github:mudler/LocalAI/gallery/virtual.yaml@master" urls: - https://huggingface.co/Jackrong/Qwopus3.6-27B-v2-MTP-GGUF @@ -4442,6 +4464,8 @@ sha256: 5c058d9f7b737167195fa54eae4a2ae17658ac2c0a8073f7f116ba006b2ab32c uri: https://huggingface.co/mudler/ced-gguf/resolve/main/ced-base-f16.gguf - name: ced-base-q8 + variants: + - model: ced-base-f16 url: github:mudler/LocalAI/gallery/ced.yaml@master urls: - https://huggingface.co/mudler/ced-gguf @@ -4488,6 +4512,8 @@ sha256: af8b81c67bae50bfca4ea83dbba77b3bae4fa6180d36c17d6877f7700aeeb77b uri: https://huggingface.co/mudler/ced-gguf/resolve/main/ced-tiny-f16.gguf - name: ced-tiny-q8 + variants: + - model: ced-tiny-f16 url: github:mudler/LocalAI/gallery/ced.yaml@master urls: - https://huggingface.co/mudler/ced-gguf @@ -4534,6 +4560,8 @@ sha256: 3c6a8936c77312f07a9ecb7b4bbbcb1f93ad137920ca6656bae9306571fb0c03 uri: https://huggingface.co/mudler/ced-gguf/resolve/main/ced-mini-f16.gguf - name: ced-mini-q8 + variants: + - model: ced-mini-f16 url: github:mudler/LocalAI/gallery/ced.yaml@master urls: - https://huggingface.co/mudler/ced-gguf @@ -4580,6 +4608,8 @@ sha256: c391ed8697a1b08d7c1a463e4940a5c3a2f670e0544ab0d8ee23b544583602a8 uri: https://huggingface.co/mudler/ced-gguf/resolve/main/ced-small-f16.gguf - name: ced-small-q8 + variants: + - model: ced-small-f16 url: github:mudler/LocalAI/gallery/ced.yaml@master urls: - https://huggingface.co/mudler/ced-gguf @@ -6056,6 +6086,8 @@ uri: huggingface://Serveurperso/Qwen3-TTS-GGUF/qwen-tokenizer-12hz-Q4_K_M.gguf - !!merge <<: *qwenttscpp_gallery name: qwen3-tts-cpp-1.7b-base + variants: + - model: qwen3-tts-cpp-1.7b-base-q4 description: | Qwen3-TTS 1.7B Base (C++ / GGML, qwentts.cpp), Q8_0 (~2.0 GB talker). Higher-quality streaming + voice cloning, 24kHz mono, 11 languages. @@ -6094,6 +6126,8 @@ uri: huggingface://Serveurperso/Qwen3-TTS-GGUF/qwen-tokenizer-12hz-Q4_K_M.gguf - !!merge <<: *qwenttscpp_gallery name: qwen3-tts-cpp-customvoice + variants: + - model: qwen3-tts-cpp-customvoice-q4 description: | Qwen3-TTS 0.6B CustomVoice (C++ / GGML, qwentts.cpp), Q8_0. Named speakers selected via the `voice` field: serena, vivian, uncle_fu, ryan, aiden, @@ -6151,6 +6185,8 @@ uri: huggingface://Serveurperso/Qwen3-TTS-GGUF/qwen-tokenizer-12hz-Q4_K_M.gguf - !!merge <<: *qwenttscpp_gallery name: qwen3-tts-cpp-1.7b-customvoice + variants: + - model: qwen3-tts-cpp-1.7b-customvoice-q4 description: | Qwen3-TTS 1.7B CustomVoice (C++ / GGML, qwentts.cpp), Q8_0. Named speakers via the `voice` field (serena, vivian, ryan, aiden, eric, dylan, ...). Streaming, @@ -6206,6 +6242,8 @@ uri: huggingface://Serveurperso/Qwen3-TTS-GGUF/qwen-tokenizer-12hz-Q4_K_M.gguf - !!merge <<: *qwenttscpp_gallery name: qwen3-tts-cpp-1.7b-voicedesign + variants: + - model: qwen3-tts-cpp-1.7b-voicedesign-q4 description: | Qwen3-TTS 1.7B VoiceDesign (C++ / GGML, qwentts.cpp), Q8_0. Synthesises a speaker from a free-text attribute instruction - REQUIRES the OpenAI @@ -6263,6 +6301,8 @@ uri: huggingface://Serveurperso/Qwen3-TTS-GGUF/qwen-tokenizer-12hz-Q4_K_M.gguf - &mossttscpp_gallery name: moss-tts-cpp-v1_5-q8_0 + variants: + - model: moss-tts-cpp-v1_5-f16 url: github:mudler/LocalAI/gallery/virtual.yaml@master urls: - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF @@ -6304,6 +6344,7 @@ uri: huggingface://mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF/moss-tokenizer-v1_5.gguf - !!merge <<: *mossttscpp_gallery name: moss-tts-cpp-v1_5-f16 + variants: [] description: | MOSS-TTS-Local v1.5 (C++/ggml, moss-tts.cpp), F16 (~9.4 GB), code-exact versus the reference. 48kHz stereo text-to-speech with reference-audio voice cloning. @@ -8019,6 +8060,8 @@ sha256: cd5a851d3928697fa1bd76d459d2cc409b6cf40c9d9682b2f5c8e7c6a9f9630f uri: huggingface://unsloth/Qwen3-VL-2B-Instruct-GGUF/mmproj-F16.gguf - name: huihui-qwen3-vl-30b-a3b-instruct-abliterated + variants: + - model: huihui-qwen3-vl-30b-a3b-instruct-abliterated-mxfp4_moe url: github:mudler/LocalAI/gallery/qwen3.yaml@master urls: - https://huggingface.co/noctrex/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF @@ -8538,6 +8581,8 @@ sha256: c5c38bfa5d8d5100e91a2e0050a0b2f3e082cd4bfd423cb527abc3b6f1ae180c uri: huggingface://bartowski/Aurore-Reveil_Koto-Small-7B-IT-GGUF/Aurore-Reveil_Koto-Small-7B-IT-Q4_K_M.gguf - name: opengvlab_internvl3_5-30b-a3b + variants: + - model: opengvlab_internvl3_5-30b-a3b-q8_0 url: github:mudler/LocalAI/gallery/qwen3.yaml@master urls: - https://huggingface.co/OpenGVLab/InternVL3_5-30B-A3B @@ -8635,6 +8680,8 @@ sha256: c9625c981969d267052464e2d345f8ff5bc7e841871f5284a2bd972461c7356d uri: huggingface://bartowski/OpenGVLab_InternVL3_5-14B-GGUF/mmproj-OpenGVLab_InternVL3_5-14B-f16.gguf - name: opengvlab_internvl3_5-14b + variants: + - model: opengvlab_internvl3_5-14b-q8_0 url: github:mudler/LocalAI/gallery/qwen3.yaml@master urls: - https://huggingface.co/OpenGVLab/InternVL3_5-14B @@ -8667,6 +8714,8 @@ sha256: c9625c981969d267052464e2d345f8ff5bc7e841871f5284a2bd972461c7356d uri: huggingface://bartowski/OpenGVLab_InternVL3_5-14B-GGUF/mmproj-OpenGVLab_InternVL3_5-14B-f16.gguf - name: opengvlab_internvl3_5-8b + variants: + - model: opengvlab_internvl3_5-8b-q8_0 url: github:mudler/LocalAI/gallery/qwen3.yaml@master urls: - https://huggingface.co/OpenGVLab/InternVL3_5-8B @@ -8729,6 +8778,8 @@ sha256: 212cc090f81ea2981b870186d4b424fae69489a5313a14e52ffdb2e877852389 uri: huggingface://bartowski/OpenGVLab_InternVL3_5-8B-GGUF/mmproj-OpenGVLab_InternVL3_5-8B-f16.gguf - name: opengvlab_internvl3_5-4b + variants: + - model: opengvlab_internvl3_5-4b-q8_0 url: github:mudler/LocalAI/gallery/qwen3.yaml@master urls: - https://huggingface.co/OpenGVLab/InternVL3_5-4B @@ -9956,6 +10007,8 @@ sha256: ebab7f90c7833fbccd46d3a555410e78d969db5438e169b6524be444862b3676 uri: https://github.com/yakhyo/face-anti-spoofing/releases/download/weights/MiniFASNetV1SE.onnx - name: insightface-opencv + variants: + - model: insightface-opencv-int8 url: github:mudler/LocalAI/gallery/virtual.yaml@master urls: - https://github.com/opencv/opencv_zoo @@ -10649,6 +10702,10 @@ sha256: 0909d8a1aba584b482d501baae032611d1559878be1b7f6606ba516687c5380d - &depth-anything-3-base name: depth-anything-3-base + variants: + - model: depth-anything-3-base-q8_0 + - model: depth-anything-3-base-f16 + - model: depth-anything-3-base-f32 url: github:mudler/LocalAI/gallery/virtual.yaml@master urls: - https://github.com/mudler/depth-anything.cpp @@ -10680,6 +10737,7 @@ sha256: "43cd45d00f9024f4319f4beabd73155db5132e4b575bc52eff4131262c9d78f1" - !!merge <<: *depth-anything-3-base name: depth-anything-3-base-q8_0 + variants: [] description: | Depth Anything 3 (base), q8_0 — near-lossless 8-bit quant (~149 MB). Same depth + camera pose output as the q4_k default at higher fidelity. @@ -10693,6 +10751,7 @@ sha256: "71b1c953113657f9a4fbef43ab6a16fe7a6f87b36da113a184f13c4a564968a0" - !!merge <<: *depth-anything-3-base name: depth-anything-3-base-f16 + variants: [] description: | Depth Anything 3 (base), f16 — half precision (~233 MB), no measurable accuracy loss vs f32. Depth + camera pose. @@ -10706,6 +10765,7 @@ sha256: "2975419c99702ca646d5b7120c53e35c9fee158f0a803577241d16957f75624b" - !!merge <<: *depth-anything-3-base name: depth-anything-3-base-f32 + variants: [] description: | Depth Anything 3 (base), f32 — maximum fidelity (~412 MB). Reference-parity depth + camera pose. @@ -10719,6 +10779,7 @@ sha256: "1b13b166e8a8b4f2c862f42d36edb2f9aab995a18cc527a52b9f160b99c6b8da" - !!merge <<: *depth-anything-3-base name: depth-anything-3-giant + variants: [] description: | Depth Anything 3 (giant / vitg), f32 — the large backbone (~4.9 GB) for maximum quality depth + camera pose. GPU recommended. @@ -10739,6 +10800,7 @@ sha256: "392edf64626be6a985487beb39c8d54cdc14f7feb2b53323742c96b71e7e7181" - !!merge <<: *depth-anything-3-base name: depth-anything-3-small + variants: [] description: | Depth Anything 3 (small / vits), f32 — the smallest backbone (~131 MB) for fast CPU depth + camera pose. Same output as base at lower latency. @@ -10752,6 +10814,7 @@ sha256: "eab5597e01dedde1a20c038590ae8c887b85ec35b882581138c08308e92c41e5" - !!merge <<: *depth-anything-3-base name: depth-anything-3-large + variants: [] description: | Depth Anything 3 (large / vitl), f32 (~1.6 GB) — higher quality depth + camera pose than base. GPU recommended for interactive use. @@ -10772,6 +10835,7 @@ sha256: "a79eb3e19e8ec49f4daac484fb5fb67e15baac61518d229cf819e40c87080906" - !!merge <<: *depth-anything-3-base name: depth-anything-3-mono-large + variants: [] description: | Depth Anything 3 (monocular large / vitl), f32 (~1.3 GB) — single-image monocular depth + a sky mask (no camera pose). DPT single-head variant; use @@ -10786,6 +10850,7 @@ sha256: "291b1a554af907c3f79986ee225da8933be5f7a31d73c81d06784cda284535de" - !!merge <<: *depth-anything-3-base name: depth-anything-3-metric-large + variants: [] description: | Depth Anything 3 (metric large / vitl), f32 (~1.3 GB) — single-image metric-scale depth (meters) + a sky mask. DPT single-head metric variant; use @@ -10801,6 +10866,7 @@ sha256: "d10b7450c2238244b2d72e2749537a1876255180149cd630a18bc1619c9286be" - !!merge <<: *depth-anything-3-base name: depth-anything-3-nested + variants: [] description: | Depth Anything 3 (nested giant+large), f32 — the recommended metric model. A two-branch pipeline: the anyview GIANT (vitg) branch and a metric ViT-L branch @@ -10832,6 +10898,10 @@ sha256: "b54ed50cbc0b0c14fae1f8edd0fea8bd1cac0850485fd6e7eb2422c7a19e570e" - &depth-anything-2-base name: depth-anything-2-base + variants: + - model: depth-anything-2-base-q8_0 + - model: depth-anything-2-base-f16 + - model: depth-anything-2-base-f32 url: github:mudler/LocalAI/gallery/virtual.yaml@master urls: - https://github.com/mudler/depth-anything.cpp @@ -10862,6 +10932,7 @@ sha256: "49e77ec7e593080111242fa76017cae3e26498d550841cf8a70dfcd36bb175f2" - !!merge <<: *depth-anything-2-base name: depth-anything-2-base-q8_0 + variants: [] description: | Depth Anything V2 (base / ViT-B), q8_0 — near-lossless 8-bit quant. Same relative monocular depth output as the q4_k default at higher fidelity. Use @@ -10876,6 +10947,7 @@ sha256: "11920ec7a8dfc2fa7fe8ed44811a46fafe415c641d13144bb733d1437832291b" - !!merge <<: *depth-anything-2-base name: depth-anything-2-base-f16 + variants: [] description: | Depth Anything V2 (base / ViT-B), f16 — half precision, no measurable accuracy loss vs f32. Relative monocular depth only (no pose). Use @@ -10890,6 +10962,7 @@ sha256: "e91c011fbbf90a44639fea55b8d61ca9e80dfb5541220946c8b6e6261fe67ab1" - !!merge <<: *depth-anything-2-base name: depth-anything-2-base-f32 + variants: [] description: | Depth Anything V2 (base / ViT-B), f32 — maximum reference fidelity. Relative monocular depth only (no pose). Use GenerateImage (src -> depth PNG) or the @@ -10904,6 +10977,7 @@ sha256: "2d3d2e4d8fae9646c17577b84c870c7d77a34ded8cf8d5da0a60b2bee1530ccc" - !!merge <<: *depth-anything-2-base name: depth-anything-2-small + variants: [] description: | Depth Anything V2 (small / ViT-S), f32 — the smallest, fastest backbone for relative monocular depth on CPU. Depth only (no pose). Use GenerateImage @@ -10918,6 +10992,7 @@ sha256: "1f6622aa70cbd0eba34d34e2f635a156ed8c3f8e158fb149eb355366e2deb899" - !!merge <<: *depth-anything-2-base name: depth-anything-2-large + variants: [] description: | Depth Anything V2 (large / ViT-L), f32 — higher-quality relative monocular depth than base. Depth only (no pose). Use GenerateImage (src -> depth PNG) @@ -10932,6 +11007,7 @@ sha256: "e187658b01b6df62e1553b03df9973606a7287551d4771b09802fc10b26f19f3" - !!merge <<: *depth-anything-2-base name: depth-anything-2-metric-hypersim-small + variants: [] description: | Depth Anything V2 Metric (Hypersim, indoor / ViT-S), q4_k — metric monocular depth in METRES (indoor, max_depth 20). Depth only (no pose). Use @@ -10953,6 +11029,7 @@ sha256: "decd99f5c756b564aae5ca1a1612f896e7f76889060e1d25ba610549bbc39b52" - !!merge <<: *depth-anything-2-base name: depth-anything-2-metric-hypersim-base + variants: [] description: | Depth Anything V2 Metric (Hypersim, indoor / ViT-B), q4_k — metric monocular depth in METRES (indoor, max_depth 20). Depth only (no pose). Use @@ -10974,6 +11051,7 @@ sha256: "c7c6a8628ac154f2ad43db09b8146518e863375be2cb03b8b46caec49a4fcf3a" - !!merge <<: *depth-anything-2-base name: depth-anything-2-metric-hypersim-large + variants: [] description: | Depth Anything V2 Metric (Hypersim, indoor / ViT-L), q4_k — highest-quality metric monocular depth in METRES (indoor, max_depth 20). Depth only (no @@ -10995,6 +11073,7 @@ sha256: "3664506bea55e64926fff2cb112ea5a9ad923d13647b9c69617184a89dd1e473" - !!merge <<: *depth-anything-2-base name: depth-anything-2-metric-vkitti-small + variants: [] description: | Depth Anything V2 Metric (Virtual KITTI, outdoor / ViT-S), q4_k — metric monocular depth in METRES (outdoor, max_depth 80). Depth only (no pose). Use @@ -11016,6 +11095,7 @@ sha256: "8dcaa5d0f8475c3dc5de59e28faacd6d46e5ef73c73ecc58e365d7751bc2279f" - !!merge <<: *depth-anything-2-base name: depth-anything-2-metric-vkitti-base + variants: [] description: | Depth Anything V2 Metric (Virtual KITTI, outdoor / ViT-B), q4_k — metric monocular depth in METRES (outdoor, max_depth 80). Depth only (no pose). Use @@ -11037,6 +11117,7 @@ sha256: "1de5a7aae674df6afb8fa5e06d67843dccfbab92cd64b7c816c1218229446d6d" - !!merge <<: *depth-anything-2-base name: depth-anything-2-metric-vkitti-large + variants: [] description: | Depth Anything V2 Metric (Virtual KITTI, outdoor / ViT-L), q4_k — highest-quality metric monocular depth in METRES (outdoor, max_depth 80). @@ -29035,6 +29116,8 @@ - &arch-router-1_5b url: github:mudler/LocalAI/gallery/chatml.yaml@master name: arch-router-1.5b-q4 + variants: + - model: arch-router-1.5b-q8 icon: https://cdn-avatars.huggingface.co/v1/production/uploads/66b681906c8d3b36786b764c/uyP7mxDVv0HbV9Hv_KfHk.jpeg license: other urls: @@ -29080,6 +29163,7 @@ uri: huggingface://mradermacher/Arch-Router-1.5B-GGUF/Arch-Router-1.5B.Q4_K_M.gguf - !!merge <<: *arch-router-1_5b name: arch-router-1.5b-q8 + variants: [] overrides: known_usecases: - score @@ -30660,6 +30744,9 @@ sha256: f4df16c641a05c4a6ca717068ba3ee312875000f6fac0efbd152915553b5fc3e uri: huggingface://second-state/stable-diffusion-3.5-large-GGUF/t5xxl-Q5_0.gguf - name: flux.1-dev + variants: + - model: flux.1-dev-ggml + - model: flux.1-dev-ggml-q8_0 url: github:mudler/LocalAI/gallery/flux.yaml@master urls: - https://huggingface.co/black-forest-labs/FLUX.1-dev @@ -30909,6 +30996,8 @@ sha256: 6e480b09fae049a72d2a8c5fbccb8d3e92febeb233bbe9dfe7256958a9167635 uri: https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp16.safetensors - name: flux.1-krea-dev-ggml + variants: + - model: flux.1-krea-dev-ggml-q8_0 url: github:mudler/LocalAI/gallery/flux-ggml.yaml@master urls: - https://huggingface.co/black-forest-labs/FLUX.1-Krea-dev @@ -31302,6 +31391,8 @@ sha256: 422f1ae452ade6f30a004d7e5c6a43195e4433bc370bf23fac9cc591f01a8898 uri: huggingface://ggerganov/whisper.cpp/ggml-base-q5_1.bin - name: whisper-base + variants: + - model: whisper-base-q5_1 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31356,6 +31447,8 @@ sha256: 4baf70dd0d7c4247ba2b81fafd9c01005ac77c2f9ef064e00dcf195d0e2fdd2f uri: huggingface://ggerganov/whisper.cpp/ggml-base.en-q5_1.bin - name: whisper-base-en + variants: + - model: whisper-base-en-q5_1 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31410,6 +31503,8 @@ sha256: d75795ecff3f83b5faa89d1900604ad8c780abd5739fae406de19f23ecd98ad1 uri: huggingface://ggerganov/whisper.cpp/ggml-large-v3-q5_0.bin - name: whisper-medium + variants: + - model: whisper-medium-q5_0 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31490,6 +31585,8 @@ sha256: ae85e4a935d7a567bd102fe55afc16bb595bdb618e11b2fc7591bc08120411bb uri: huggingface://ggerganov/whisper.cpp/ggml-small-q5_1.bin - name: whisper-small + variants: + - model: whisper-small-q5_1 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31544,6 +31641,8 @@ sha256: bfdff4894dcb76bbf647d56263ea2a96645423f1669176f4844a1bf8e478ad30 uri: huggingface://ggerganov/whisper.cpp/ggml-small.en-q5_1.bin - name: whisper-small-en + variants: + - model: whisper-small-en-q5_1 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31598,6 +31697,8 @@ sha256: ae85e4a935d7a567bd102fe55afc16bb595bdb618e11b2fc7591bc08120411bb uri: huggingface://ggerganov/whisper.cpp/ggml-small-q5_1.bin - name: whisper-tiny + variants: + - model: whisper-tiny-q5_1 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31677,6 +31778,9 @@ sha256: c77c5766f1cef09b6b7d47f21b546cbddd4157886b3b5d6d4f709e91e66c7c2b uri: huggingface://ggerganov/whisper.cpp/ggml-tiny.en-q5_1.bin - name: whisper-tiny-en + variants: + - model: whisper-tiny-en-q5_1 + - model: whisper-tiny-en-q8_0 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31728,6 +31832,8 @@ sha256: 5bc2b3860aa151a4c6e7bb095e1fcce7cf12c7b020ca08dcec0c6d018bb7dd94 uri: huggingface://ggerganov/whisper.cpp/ggml-tiny.en-q8_0.bin - name: whisper-large + variants: + - model: whisper-large-q5_0 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -31781,6 +31887,9 @@ sha256: d75795ecff3f83b5faa89d1900604ad8c780abd5739fae406de19f23ecd98ad1 uri: huggingface://ggerganov/whisper.cpp/ggml-large-v3-q5_0.bin - name: whisper-large-turbo + variants: + - model: whisper-large-turbo-q5_0 + - model: whisper-large-turbo-q8_0 url: github:mudler/LocalAI/gallery/whisper-base.yaml@master urls: - https://github.com/ggerganov/whisper.cpp @@ -35020,6 +35129,8 @@ sha256: af8cb9e4ca0bf19eb54d08c612fdf325059264abbbd2c619527e5d2dda8de655 uri: https://huggingface.co/mradermacher/nomic-embed-text-v1.5-GGUF/resolve/main/nomic-embed-text-v1.5.f16.gguf - name: silero-vad + variants: + - model: silero-vad-ggml url: github:mudler/LocalAI/gallery/virtual.yaml@master urls: - https://github.com/snakers4/silero-vad @@ -36314,6 +36425,8 @@ sha256: 0a599099e93ad521045e17d82365a73c1738fff0603d6cb2c9557e96fbc907cb uri: huggingface://mradermacher/YanoljaNEXT-Rosetta-27B-2511-i1-GGUF/YanoljaNEXT-Rosetta-27B-2511.i1-Q4_K_M.gguf - name: orca-agent-v0.1 + variants: + - model: orca-agent-v0.1-i1 url: github:mudler/LocalAI/gallery/qwen3.yaml@master urls: - https://huggingface.co/mradermacher/Orca-Agent-v0.1-GGUF @@ -36539,6 +36652,9 @@ uri: huggingface://unsloth/LTX-2.3-GGUF/text_encoders/ltx-2.3-22b-dev_embeddings_connectors.safetensors - !!merge <<: *ltx-2-3-dev-ggml name: ltx-2.3-22b-dev-ggml-q4_k_m + variants: + - model: ltx-2.3-22b-dev-ggml + - model: ltx-2.3-22b-dev-ggml-q8_0 description: | LTX-2.3 22B dev - non-dynamic Q4_K_M quantization (~14.3 GB). Same pipeline as ltx-2.3-22b-dev-ggml but with the plain Q4_K_M weights @@ -36666,6 +36782,9 @@ uri: huggingface://unsloth/LTX-2.3-GGUF/text_encoders/ltx-2.3-22b-distilled_embeddings_connectors.safetensors - !!merge <<: *ltx-2-3-distilled-ggml name: ltx-2.3-22b-distilled-ggml-q4_k_m + variants: + - model: ltx-2.3-22b-distilled-ggml + - model: ltx-2.3-22b-distilled-ggml-q8_0 description: | LTX-2.3 22B distilled - non-dynamic Q4_K_M quantization (~14.3 GB). Same pipeline as ltx-2.3-22b-distilled-ggml but with the plain Q4_K_M