chore(gallery): add Clef-Flash GGUF variants

Add Q4_K_M and Q8_0 builds with a pinned vision projector for native
llama.cpp decisions. Document installation and variant selection.

Assisted-by: Codex:gpt-6
This commit is contained in:
localai-org-maint-bot committed 2026-10-10 16:05:14 +00:00
1 parent c5e40336b0
commit 1081971697
2 files changed
+87 -1

No files matched your search

+21 -1
View File
@@ -450,6 +450,26 @@ probes also check serialized escaping before allocation. The separate 64 KiB tex
request limit is unchanged. Anthropic conversion preserves typed content blocks
through both native selection and fallback, including ordered text and images.
### Clef-Flash text and image decisions
Install Cloudflare's 9B Clef-Flash decision model with its Q8_0 vision projector:
```sh
local-ai models install clef-flash --variant clef-flash
```
This selects the Q4_K_M build. Use `--variant clef-flash-q8` for Q8_0,
or omit `--variant` to let the gallery choose a build for available memory.
Both builds use Apache-2.0 weights from
[ggml-org/Clef-Flash-GGUF](https://huggingface.co/ggml-org/Clef-Flash-GGUF),
pinned to revision `4a192915ef971886004b5b13294f2b4c7a7fc39d` with SHA-256 checksums.
Send requests to `/v1/systemone` or `/v1/decisions` with the installed model's
name. Clef-Flash returns typed decisions; it does not generate chat completions.
Image requests use the same bounded base64 image contract described above.
The gallery sets an 8192-token context. Use a current stock `llama-cpp` backend
with Clef decision support.
### OpenJev image decisions
The `openjev-llama-cpp` gallery entry installs OpenJev Q4_K_M and its pinned
@@ -470,7 +490,7 @@ fit; context overflow remains an error. Size the context for the actual workload
Native image decisions require both a decision format that accepts images and a
loaded projector that supports **vision input**. A missing projector, an
audio-only projector, or a text-only decision model does not silently fall back
to a text decision. Other decision gallery entries remain text-only.
to a text decision. Image support also requires a matching projector for Clef-Flash.
Direct native RPC callers receive the same image count, encoded/decoded byte,
dimension and aggregate pixel bounds as public callers. Validation precedes
+66
View File
@@ -65584,6 +65584,72 @@
- filename: lev-Q4_K_M.gguf
uri: https://huggingface.co/ggml-org/lev-GGUF/resolve/3e9286a79ae857b4e1de051c92fab6dc574581ce/lev-Q4_K_M.gguf
sha256: 3f61b27c00a098dbc79ed099cca3985cbe0b63d17ac7fedebf2dca1d84f7f3a8
- name: clef-flash
url: github:mudler/LocalAI/gallery/virtual.yaml@master
variants:
- model: clef-flash-q8
urls:
- https://huggingface.co/Cloudflare/clef-flash
- https://huggingface.co/ggml-org/Clef-Flash-GGUF
license: apache-2.0
description: |
Clef-Flash is Cloudflare's 9B Qwen3.5-based model for typed decisions
from text and images. This Q4_K_M GGUF includes the Q8_0 vision projector
and uses native llama.cpp decisions through /v1/systemone and /v1/decisions.
It answers choice, score, and predicate questions without generating text.
tags:
- decisions
- systemone
- gguf
- cpu
- gpu
overrides:
backend: llama-cpp
known_usecases:
- decisions
context_size: 8192
mmproj: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
parameters:
model: llama-cpp/models/clef-flash/Clef-Flash-Q4_K_M.gguf
files:
- filename: llama-cpp/models/clef-flash/Clef-Flash-Q4_K_M.gguf
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/Clef-Flash-Q4_K_M.gguf
sha256: fd3e90605e8103307dca37cb5a8cdb036267e2fe3cb2d908d80a8ceb9ec0638c
- filename: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/mmproj-Clef-Flash-Q8_0.gguf
sha256: 3fbc646617c56c35ba48e06f0fbe8693a83bde49eb31e2a3bf59ba0a308c9e25
- name: clef-flash-q8
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/Cloudflare/clef-flash
- https://huggingface.co/ggml-org/Clef-Flash-GGUF
license: apache-2.0
description: |
Clef-Flash is Cloudflare's 9B Qwen3.5-based model for typed decisions
from text and images. This Q8_0 GGUF includes the Q8_0 vision projector
and uses native llama.cpp decisions through /v1/systemone and /v1/decisions.
It answers choice, score, and predicate questions without generating text.
tags:
- decisions
- systemone
- gguf
- cpu
- gpu
overrides:
backend: llama-cpp
known_usecases:
- decisions
context_size: 8192
mmproj: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
parameters:
model: llama-cpp/models/clef-flash/Clef-Flash-Q8_0.gguf
files:
- filename: llama-cpp/models/clef-flash/Clef-Flash-Q8_0.gguf
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/Clef-Flash-Q8_0.gguf
sha256: d7c352faf1bdd9ea24d0b9347e8eb1eb4bbadeff6c02383bf750215a74f2f1f1
- filename: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/mmproj-Clef-Flash-Q8_0.gguf
sha256: 3fbc646617c56c35ba48e06f0fbe8693a83bde49eb31e2a3bf59ba0a308c9e25
- name: openjev-llama-cpp
urls:
- https://huggingface.co/openjev/openjev