mirror of
https://github.com/mudler/LocalAI.git
synced 2026-09-20 21:28:16 -04:00
feat(gallery): add Occamy-1.0 GGUF variants
Add the publisher's Q4_K_M and Q8_0 builds with the F16 vision projector. Link the builds as variants and pin downloads to a verified revision. Document installation and the source tokenizer's NFC requirement. Assisted-by: Codex:gpt-6
This commit is contained in:
1 parent
96ccb8e96c
commit
aaaa400c8c
2 files changed
+117
No files matched your search
@@ -937,3 +937,32 @@ These entries set a 131,072-token context, following the
|
||||
[model card's guidance](https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-Final-GGUF)
|
||||
for thinking mode. This context requires additional memory beyond the weights.
|
||||
The uncensored model uses the Apache-2.0 license.
|
||||
|
||||
### Occamy-1.0
|
||||
|
||||
[Occamy-1.0](https://huggingface.co/Accio-Lab/occamy-1.0) is a
|
||||
Qwen3.6-35B-A3B derivative trained for multi-step agent tasks and coding.
|
||||
Install it with:
|
||||
|
||||
```bash
|
||||
local-ai models install occamy-1.0-q4
|
||||
```
|
||||
|
||||
The gallery offers Q4_K_M and Q8_0 GGUF builds for llama.cpp. Each build
|
||||
includes the F16 vision projector and uses the embedded Jinja chat template.
|
||||
LocalAI selects the variant according to available memory. To select Q4_K_M
|
||||
explicitly:
|
||||
|
||||
```bash
|
||||
local-ai models install --variant occamy-1.0-q4 occamy-1.0-q4
|
||||
```
|
||||
|
||||
Both entries use an 8,192-token context. Neither enables the publisher's
|
||||
separate experimental MTP head.
|
||||
|
||||
Normalize prompt text to Unicode NFC in your client before sending requests.
|
||||
The GGUF tokenizer does not apply the source tokenizer's NFC normalization.
|
||||
Keep the embedded `qwen2` pre-tokenizer setting; the publisher's benchmark
|
||||
used a different setting. See the publisher's
|
||||
[tokenizer compatibility notes](https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/blob/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/TOKENIZER.md)
|
||||
for the validation limits.
|
||||
@@ -7267,6 +7267,94 @@
|
||||
- filename: llama-cpp/mmproj/Hermes3.6-35B-A3B-Uncensored-Genesis-V6-Q8_0/mmproj-Hermes3.6-35B-A3B-Uncensored-Genesis-F16.gguf
|
||||
uri: https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V6-GGUF/resolve/main/mmproj-Hermes3.6-35B-A3B-Uncensored-Genesis-F16.gguf
|
||||
sha256: f7197461d8581cd9be42384d4afe3f851d0844f6d72846d5c97e3dcc931b3cbc
|
||||
- name: occamy-1.0-q4
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
variants:
|
||||
- model: occamy-1.0-q8
|
||||
urls:
|
||||
- https://huggingface.co/Accio-Lab/occamy-1.0
|
||||
- https://huggingface.co/Accio-Lab/occamy-1.0-GGUF
|
||||
license: apache-2.0
|
||||
description: |
|
||||
Occamy-1.0 is a 35B MoE model with 3B active parameters, based on
|
||||
Qwen3.6-35B-A3B and trained for multi-step agent tasks and coding.
|
||||
This Q4_K_M GGUF build includes the F16 vision projector and uses
|
||||
the embedded Jinja chat template with an 8K-token default context.
|
||||
Normalize prompt text to Unicode NFC to match the source tokenizer.
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- cpu
|
||||
- gpu
|
||||
- vision
|
||||
- coding
|
||||
last_checked: "2026-09-20"
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 8192
|
||||
known_usecases:
|
||||
- chat
|
||||
- vision
|
||||
mmproj: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf
|
||||
options:
|
||||
- use_jinja:true
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
function:
|
||||
grammar:
|
||||
disable: true
|
||||
parameters:
|
||||
model: llama-cpp/models/occamy-1.0/occamy-1.0-Q4_K_M.gguf
|
||||
files:
|
||||
- filename: llama-cpp/models/occamy-1.0/occamy-1.0-Q4_K_M.gguf
|
||||
uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/occamy-1.0-Q4_K_M.gguf
|
||||
sha256: ffb25f763ff9c27f5f4e2adcdef399c5654f9f840fdac33dffe7035ba8266a87
|
||||
- filename: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf
|
||||
uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/mmproj-occamy-1.0-F16.gguf
|
||||
sha256: 8f827a1e495f23e987686a7f55c26064270502a5b6ee954a828f1aec0b2fd400
|
||||
- name: occamy-1.0-q8
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
urls:
|
||||
- https://huggingface.co/Accio-Lab/occamy-1.0
|
||||
- https://huggingface.co/Accio-Lab/occamy-1.0-GGUF
|
||||
license: apache-2.0
|
||||
description: |
|
||||
Occamy-1.0 is a 35B MoE model with 3B active parameters, based on
|
||||
Qwen3.6-35B-A3B and trained for multi-step agent tasks and coding.
|
||||
This Q8_0 GGUF build includes the F16 vision projector and uses
|
||||
the embedded Jinja chat template with an 8K-token default context.
|
||||
Normalize prompt text to Unicode NFC to match the source tokenizer.
|
||||
tags:
|
||||
- llm
|
||||
- gguf
|
||||
- cpu
|
||||
- gpu
|
||||
- vision
|
||||
- coding
|
||||
last_checked: "2026-09-20"
|
||||
overrides:
|
||||
backend: llama-cpp
|
||||
context_size: 8192
|
||||
known_usecases:
|
||||
- chat
|
||||
- vision
|
||||
mmproj: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf
|
||||
options:
|
||||
- use_jinja:true
|
||||
template:
|
||||
use_tokenizer_template: true
|
||||
function:
|
||||
grammar:
|
||||
disable: true
|
||||
parameters:
|
||||
model: llama-cpp/models/occamy-1.0/occamy-1.0-Q8_0.gguf
|
||||
files:
|
||||
- filename: llama-cpp/models/occamy-1.0/occamy-1.0-Q8_0.gguf
|
||||
uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/occamy-1.0-Q8_0.gguf
|
||||
sha256: 9bd6eceae8434098c8c7ebec33e4ca0d0bd3f004c2bddf37d16cd906448fdbdd
|
||||
- filename: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf
|
||||
uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/mmproj-occamy-1.0-F16.gguf
|
||||
sha256: 8f827a1e495f23e987686a7f55c26064270502a5b6ee954a828f1aec0b2fd400
|
||||
- &qwen3-6-35b-a3b-genesis-hermes-v7
|
||||
name: "qwen3.6-35b-a3b-genesis-hermes-v7"
|
||||
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
|
||||
|
||||
Reference in new issue
Block a user