mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 09:08:54 -04:00
chore(gallery): add Clef-Flash GGUF variants
Add Q4_K_M and Q8_0 builds with a pinned vision projector for native llama.cpp decisions. Document installation and variant selection. Assisted-by: Codex:gpt-6
This commit is contained in:
1 parent
c5e40336b0
commit
1081971697
2 files changed
+87
-1
No files matched your search
@@ -450,6 +450,26 @@ probes also check serialized escaping before allocation. The separate 64 KiB tex
|
||||
request limit is unchanged. Anthropic conversion preserves typed content blocks
|
||||
through both native selection and fallback, including ordered text and images.
|
||||
|
||||
### Clef-Flash text and image decisions
|
||||
|
||||
Install Cloudflare's 9B Clef-Flash decision model with its Q8_0 vision projector:
|
||||
|
||||
```sh
|
||||
local-ai models install clef-flash --variant clef-flash
|
||||
```
|
||||
|
||||
This selects the Q4_K_M build. Use `--variant clef-flash-q8` for Q8_0,
|
||||
or omit `--variant` to let the gallery choose a build for available memory.
|
||||
Both builds use Apache-2.0 weights from
|
||||
[ggml-org/Clef-Flash-GGUF](https://huggingface.co/ggml-org/Clef-Flash-GGUF),
|
||||
pinned to revision `4a192915ef971886004b5b13294f2b4c7a7fc39d` with SHA-256 checksums.
|
||||
|
||||
Send requests to `/v1/systemone` or `/v1/decisions` with the installed model's
|
||||
name. Clef-Flash returns typed decisions; it does not generate chat completions.
|
||||
Image requests use the same bounded base64 image contract described above.
|
||||
The gallery sets an 8192-token context. Use a current stock `llama-cpp` backend
|
||||
with Clef decision support.
|
||||
|
||||
### OpenJev image decisions
|
||||
|
||||
The `openjev-llama-cpp` gallery entry installs OpenJev Q4_K_M and its pinned
|
||||
@@ -470,7 +490,7 @@ fit; context overflow remains an error. Size the context for the actual workload
|
||||
Native image decisions require both a decision format that accepts images and a
|
||||
loaded projector that supports **vision input**. A missing projector, an
|
||||
audio-only projector, or a text-only decision model does not silently fall back
|
||||
to a text decision. Other decision gallery entries remain text-only.
|
||||
to a text decision. Image support also requires a matching projector for Clef-Flash.
|
||||
|
||||
Direct native RPC callers receive the same image count, encoded/decoded byte,
|
||||
dimension and aggregate pixel bounds as public callers. Validation precedes
|
||||
|
||||
@@ -65584,6 +65584,72 @@
|
||||
- filename: lev-Q4_K_M.gguf
|
||||
uri: https://huggingface.co/ggml-org/lev-GGUF/resolve/3e9286a79ae857b4e1de051c92fab6dc574581ce/lev-Q4_K_M.gguf
|
||||
sha256: 3f61b27c00a098dbc79ed099cca3985cbe0b63d17ac7fedebf2dca1d84f7f3a8
|
||||
- name: clef-flash
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
variants:
|
||||
- model: clef-flash-q8
|
||||
urls:
|
||||
- https://huggingface.co/Cloudflare/clef-flash
|
||||
- https://huggingface.co/ggml-org/Clef-Flash-GGUF
|
||||
license: apache-2.0
|
||||
description: |
|
||||
Clef-Flash is Cloudflare's 9B Qwen3.5-based model for typed decisions
|
||||
from text and images. This Q4_K_M GGUF includes the Q8_0 vision projector
|
||||
and uses native llama.cpp decisions through /v1/systemone and /v1/decisions.
|
||||
It answers choice, score, and predicate questions without generating text.
|
||||
tags:
|
||||
- decisions
|
||||
- systemone
|
||||
- gguf
|
||||
- cpu
|
||||
- gpu
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
known_usecases:
|
||||
- decisions
|
||||
context_size: 8192
|
||||
mmproj: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
|
||||
parameters:
|
||||
model: llama-cpp/models/clef-flash/Clef-Flash-Q4_K_M.gguf
|
||||
files:
|
||||
- filename: llama-cpp/models/clef-flash/Clef-Flash-Q4_K_M.gguf
|
||||
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/Clef-Flash-Q4_K_M.gguf
|
||||
sha256: fd3e90605e8103307dca37cb5a8cdb036267e2fe3cb2d908d80a8ceb9ec0638c
|
||||
- filename: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
|
||||
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/mmproj-Clef-Flash-Q8_0.gguf
|
||||
sha256: 3fbc646617c56c35ba48e06f0fbe8693a83bde49eb31e2a3bf59ba0a308c9e25
|
||||
- name: clef-flash-q8
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
urls:
|
||||
- https://huggingface.co/Cloudflare/clef-flash
|
||||
- https://huggingface.co/ggml-org/Clef-Flash-GGUF
|
||||
license: apache-2.0
|
||||
description: |
|
||||
Clef-Flash is Cloudflare's 9B Qwen3.5-based model for typed decisions
|
||||
from text and images. This Q8_0 GGUF includes the Q8_0 vision projector
|
||||
and uses native llama.cpp decisions through /v1/systemone and /v1/decisions.
|
||||
It answers choice, score, and predicate questions without generating text.
|
||||
tags:
|
||||
- decisions
|
||||
- systemone
|
||||
- gguf
|
||||
- cpu
|
||||
- gpu
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
known_usecases:
|
||||
- decisions
|
||||
context_size: 8192
|
||||
mmproj: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
|
||||
parameters:
|
||||
model: llama-cpp/models/clef-flash/Clef-Flash-Q8_0.gguf
|
||||
files:
|
||||
- filename: llama-cpp/models/clef-flash/Clef-Flash-Q8_0.gguf
|
||||
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/Clef-Flash-Q8_0.gguf
|
||||
sha256: d7c352faf1bdd9ea24d0b9347e8eb1eb4bbadeff6c02383bf750215a74f2f1f1
|
||||
- filename: llama-cpp/mmproj/clef-flash/mmproj-Clef-Flash-Q8_0.gguf
|
||||
uri: https://huggingface.co/ggml-org/Clef-Flash-GGUF/resolve/4a192915ef971886004b5b13294f2b4c7a7fc39d/mmproj-Clef-Flash-Q8_0.gguf
|
||||
sha256: 3fbc646617c56c35ba48e06f0fbe8693a83bde49eb31e2a3bf59ba0a308c9e25
|
||||
- name: openjev-llama-cpp
|
||||
urls:
|
||||
- https://huggingface.co/openjev/openjev
|
||||
|
||||
Reference in new issue
Block a user