mirror/LocalAI
1
0 Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-10-28 09:08:54 -04:00
Code Issues Packages Projects Releases Wiki Activity

chore(gallery): add Clef GGUF variants

Browse Source 
Add the 27B Clef decision model with Q4_K_M and Q8_0 builds and a
matching vision projector. Pin artifacts and document installation.

Assisted-by: Codex:gpt-6

(cherry picked from commit ab88ee821e, mudler/LocalAI#12613)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
localai-org-maint-bot authored and Ettore Di Giacinto committed 2026-10-13 07:29:52 +00:00
1 parent 508c672e7d
commit f4963e30bf
1 file changed
+66
Download Patch File Download Diff File Expand all files Collapse all files
gallery/index.yaml
+66
View File
@@ -67315,6 +67315,72 @@
- filename: Kev-4B-Q4_K_M.gguf
uri: https://huggingface.co/ggml-org/Kev-4B-GGUF/resolve/d924f2e2c3872da8b8aaf3eb4453b4126deceb79/Kev-4B-Q4_K_M.gguf
sha256: 33ae6b18926502b2209a1bf7d3b61a350d65938441515c686bb87d226a19eff9
- name: clef
url: github:mudler/LocalAI/gallery/virtual.yaml@master
variants:
- model: clef-q8
urls:
- https://huggingface.co/Cloudflare/clef
- https://huggingface.co/ggml-org/Clef-GGUF
license: apache-2.0
description: |
Clef is Cloudflare's 27B Qwen3.8-based model for typed decisions
from text and images. This Q4_K_M GGUF includes the Q8_0 vision projector
and uses native llama.cpp decisions through /v1/systemone and /v1/decisions.
It answers choice, score, and predicate questions without generating text.
tags:
- decisions
- systemone
- gguf
- cpu
- gpu
overrides:
backend: llama-cpp
known_usecases:
- decisions
context_size: 8192
mmproj: llama-cpp/mmproj/clef/mmproj-Clef-Q8_0.gguf
parameters:
model: llama-cpp/models/clef/Clef-Q4_K_M.gguf
files:
- filename: llama-cpp/models/clef/Clef-Q4_K_M.gguf
uri: https://huggingface.co/ggml-org/Clef-GGUF/resolve/63840a1a68cb7084c88610cffc328509356b04cb/Clef-Q4_K_M.gguf
sha256: bd9b8ae24c5752a2bb5e2733d5168340d5f04457e02b8bf0d1bc9285ec3d4f61
- filename: llama-cpp/mmproj/clef/mmproj-Clef-Q8_0.gguf
uri: https://huggingface.co/ggml-org/Clef-GGUF/resolve/63840a1a68cb7084c88610cffc328509356b04cb/mmproj-Clef-Q8_0.gguf
sha256: 0d901ea999ae122ba0afeb4a3f4c4ac9a90baa07f1d120df9c350082db1190a8
- name: clef-q8
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/Cloudflare/clef
- https://huggingface.co/ggml-org/Clef-GGUF
license: apache-2.0
description: |
Clef is Cloudflare's 27B Qwen3.8-based model for typed decisions
from text and images. This Q8_0 GGUF includes the Q8_0 vision projector
and uses native llama.cpp decisions through /v1/systemone and /v1/decisions.
It answers choice, score, and predicate questions without generating text.
tags:
- decisions
- systemone
- gguf
- cpu
- gpu
overrides:
backend: llama-cpp
known_usecases:
- decisions
context_size: 8192
mmproj: llama-cpp/mmproj/clef/mmproj-Clef-Q8_0.gguf
parameters:
model: llama-cpp/models/clef/Clef-Q8_0.gguf
files:
- filename: llama-cpp/models/clef/Clef-Q8_0.gguf
uri: https://huggingface.co/ggml-org/Clef-GGUF/resolve/63840a1a68cb7084c88610cffc328509356b04cb/Clef-Q8_0.gguf
sha256: 07c6410af7011e0e56873a3b0b3f4ad9e31fb176f0ca80d6fd1525fe6f036548
- filename: llama-cpp/mmproj/clef/mmproj-Clef-Q8_0.gguf
uri: https://huggingface.co/ggml-org/Clef-GGUF/resolve/63840a1a68cb7084c88610cffc328509356b04cb/mmproj-Clef-Q8_0.gguf
sha256: 0d901ea999ae122ba0afeb4a3f4c4ac9a90baa07f1d120df9c350082db1190a8
- name: lev-llama-cpp
urls:
- https://huggingface.co/interfaze-ai/lev