chore(gallery): add Pi Q5 and Q6 variants

Offer intermediate GGUF quantizations for Qwen3.8-27B-pi. Reuse the
existing llama.cpp configuration and pinned BF16 vision projector.

Cross-check the artifact SHA256 values against Hugging Face LFS
metadata and download headers.

Assisted-by: Codex:gpt-6
This commit is contained in:
localai-org-maint-bot committed 2026-10-09 16:04:11 +00:00
1 parent 1997c6cb83
commit a240bc07bd
2 files changed
+115

No files matched your search

+19
View File
@@ -187,6 +187,25 @@ To select Q8 explicitly, run `local-ai models install cyber-tiel-coder-35b-a3b-q
Both configurations use the embedded chat template and default to 32,768 context tokens.
The [model card](https://huggingface.co/peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP) describes its abliterated Ornith-1.5 base and MIT license.
## Qwen3.8-27B Pi
The `qwen3.8-27b-pi` entry offers Q4_K_M, Q5_K_M, Q6_K, Q8_0, and
Q4_K_M with MTP builds for llama.cpp. This fine-tune targets coding and
tool use in the Pi agent harness. Each build includes the BF16 vision
projector and uses the embedded chat template.
To select one of the intermediate quantizations explicitly:
```bash
local-ai models install qwen3.8-27b-pi --variant qwen3.8-27b-pi-q5
local-ai models install qwen3.8-27b-pi --variant qwen3.8-27b-pi-q6
```
The Q5 and Q6 builds use a 32,768-token context and do not enable MTP.
Downloads are pinned to a revision and checked with SHA256. See the
[publisher's model card](https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF)
for model details.
## Qwen3.8-27B Agention Precision
The gallery includes Agention Precision IQ4_XS and Q4_K_M GGUF builds of
+96
View File
@@ -67747,6 +67747,8 @@
sha256: 82b7adb44411dbb298b1c689567804e5ed0790d80f308ed8b5b6b8ac0527d2ac
- name: qwen3.8-27b-pi
variants:
- model: qwen3.8-27b-pi-q5
- model: qwen3.8-27b-pi-q6
- model: qwen3.8-27b-pi-q8
- model: qwen3.8-27b-pi-q4-mtp
url: github:mudler/LocalAI/gallery/virtual.yaml@master
@@ -67795,6 +67797,100 @@
- filename: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
sha256: 6086d2fb198687fbd5961f9b4e5847979dfd3ac73420aada6ce72d4fc9d80f2a
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/mmproj-Qwen3.8-27B-pi-BF16.gguf
- name: qwen3.8-27b-pi-q5
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/bytkim/Qwen3.8-27B-pi
- https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF
description: |
Qwen3.8-27B-pi is a 27B fine-tune for coding and tool use in the Pi agent harness.
This Q5_K_M GGUF build uses llama.cpp, the embedded chat template, and the BF16 vision projector.
license: apache-2.0
tags:
- llm
- gguf
- cpu
- gpu
- coding
- reasoning
- vision
- multimodal
last_checked: "2026-10-09"
overrides:
backend: llama-cpp
context_size: 32768
function:
automatic_tool_parsing_fallback: true
grammar:
disable: true
known_usecases:
- chat
- vision
mmproj: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
options:
- use_jinja:true
template:
use_tokenizer_template: true
parameters:
model: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q5_K_M.gguf
temperature: 1.0
top_p: 0.95
top_k: 20
min_p: 0.0
files:
- filename: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q5_K_M.gguf
sha256: c6a9a66cd17a3627948fd1cf4730835423379aee926b33c0cfa94963b1968fd1
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/Qwen3.8-27B-pi-Q5_K_M.gguf
- filename: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
sha256: 6086d2fb198687fbd5961f9b4e5847979dfd3ac73420aada6ce72d4fc9d80f2a
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/mmproj-Qwen3.8-27B-pi-BF16.gguf
- name: qwen3.8-27b-pi-q6
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/bytkim/Qwen3.8-27B-pi
- https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF
description: |
Qwen3.8-27B-pi is a 27B fine-tune for coding and tool use in the Pi agent harness.
This Q6_K GGUF build uses llama.cpp, the embedded chat template, and the BF16 vision projector.
license: apache-2.0
tags:
- llm
- gguf
- cpu
- gpu
- coding
- reasoning
- vision
- multimodal
last_checked: "2026-10-09"
overrides:
backend: llama-cpp
context_size: 32768
function:
automatic_tool_parsing_fallback: true
grammar:
disable: true
known_usecases:
- chat
- vision
mmproj: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
options:
- use_jinja:true
template:
use_tokenizer_template: true
parameters:
model: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q6_K.gguf
temperature: 1.0
top_p: 0.95
top_k: 20
min_p: 0.0
files:
- filename: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q6_K.gguf
sha256: 8a7e614810ad9da748903753c07b5beba2f99b355170fe36832eb0acee5183f3
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/Qwen3.8-27B-pi-Q6_K.gguf
- filename: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
sha256: 6086d2fb198687fbd5961f9b4e5847979dfd3ac73420aada6ce72d4fc9d80f2a
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/mmproj-Qwen3.8-27B-pi-BF16.gguf
- name: qwen3.8-27b-pi-q8
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls: