diff --git a/docs/content/features/model-gallery.md b/docs/content/features/model-gallery.md index bc8e524c6..47a7e25c6 100644 --- a/docs/content/features/model-gallery.md +++ b/docs/content/features/model-gallery.md @@ -937,3 +937,32 @@ These entries set a 131,072-token context, following the [model card's guidance](https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-Final-GGUF) for thinking mode. This context requires additional memory beyond the weights. The uncensored model uses the Apache-2.0 license. + +### Occamy-1.0 + +[Occamy-1.0](https://huggingface.co/Accio-Lab/occamy-1.0) is a +Qwen3.6-35B-A3B derivative trained for multi-step agent tasks and coding. +Install it with: + +```bash +local-ai models install occamy-1.0-q4 +``` + +The gallery offers Q4_K_M and Q8_0 GGUF builds for llama.cpp. Each build +includes the F16 vision projector and uses the embedded Jinja chat template. +LocalAI selects the variant according to available memory. To select Q4_K_M +explicitly: + +```bash +local-ai models install --variant occamy-1.0-q4 occamy-1.0-q4 +``` + +Both entries use an 8,192-token context. Neither enables the publisher's +separate experimental MTP head. + +Normalize prompt text to Unicode NFC in your client before sending requests. +The GGUF tokenizer does not apply the source tokenizer's NFC normalization. +Keep the embedded `qwen2` pre-tokenizer setting; the publisher's benchmark +used a different setting. See the publisher's +[tokenizer compatibility notes](https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/blob/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/TOKENIZER.md) +for the validation limits. diff --git a/gallery/index.yaml b/gallery/index.yaml index 92832226e..2e09ad935 100644 --- a/gallery/index.yaml +++ b/gallery/index.yaml @@ -7267,6 +7267,94 @@ - filename: llama-cpp/mmproj/Hermes3.6-35B-A3B-Uncensored-Genesis-V6-Q8_0/mmproj-Hermes3.6-35B-A3B-Uncensored-Genesis-F16.gguf uri: https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V6-GGUF/resolve/main/mmproj-Hermes3.6-35B-A3B-Uncensored-Genesis-F16.gguf sha256: f7197461d8581cd9be42384d4afe3f851d0844f6d72846d5c97e3dcc931b3cbc +- name: occamy-1.0-q4 + url: github:mudler/LocalAI/gallery/virtual.yaml@master + variants: + - model: occamy-1.0-q8 + urls: + - https://huggingface.co/Accio-Lab/occamy-1.0 + - https://huggingface.co/Accio-Lab/occamy-1.0-GGUF + license: apache-2.0 + description: | + Occamy-1.0 is a 35B MoE model with 3B active parameters, based on + Qwen3.6-35B-A3B and trained for multi-step agent tasks and coding. + This Q4_K_M GGUF build includes the F16 vision projector and uses + the embedded Jinja chat template with an 8K-token default context. + Normalize prompt text to Unicode NFC to match the source tokenizer. + tags: + - llm + - gguf + - cpu + - gpu + - vision + - coding + last_checked: "2026-09-20" + overrides: + backend: llama-cpp + context_size: 8192 + known_usecases: + - chat + - vision + mmproj: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf + options: + - use_jinja:true + template: + use_tokenizer_template: true + function: + grammar: + disable: true + parameters: + model: llama-cpp/models/occamy-1.0/occamy-1.0-Q4_K_M.gguf + files: + - filename: llama-cpp/models/occamy-1.0/occamy-1.0-Q4_K_M.gguf + uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/occamy-1.0-Q4_K_M.gguf + sha256: ffb25f763ff9c27f5f4e2adcdef399c5654f9f840fdac33dffe7035ba8266a87 + - filename: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf + uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/mmproj-occamy-1.0-F16.gguf + sha256: 8f827a1e495f23e987686a7f55c26064270502a5b6ee954a828f1aec0b2fd400 +- name: occamy-1.0-q8 + url: github:mudler/LocalAI/gallery/virtual.yaml@master + urls: + - https://huggingface.co/Accio-Lab/occamy-1.0 + - https://huggingface.co/Accio-Lab/occamy-1.0-GGUF + license: apache-2.0 + description: | + Occamy-1.0 is a 35B MoE model with 3B active parameters, based on + Qwen3.6-35B-A3B and trained for multi-step agent tasks and coding. + This Q8_0 GGUF build includes the F16 vision projector and uses + the embedded Jinja chat template with an 8K-token default context. + Normalize prompt text to Unicode NFC to match the source tokenizer. + tags: + - llm + - gguf + - cpu + - gpu + - vision + - coding + last_checked: "2026-09-20" + overrides: + backend: llama-cpp + context_size: 8192 + known_usecases: + - chat + - vision + mmproj: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf + options: + - use_jinja:true + template: + use_tokenizer_template: true + function: + grammar: + disable: true + parameters: + model: llama-cpp/models/occamy-1.0/occamy-1.0-Q8_0.gguf + files: + - filename: llama-cpp/models/occamy-1.0/occamy-1.0-Q8_0.gguf + uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/occamy-1.0-Q8_0.gguf + sha256: 9bd6eceae8434098c8c7ebec33e4ca0d0bd3f004c2bddf37d16cd906448fdbdd + - filename: llama-cpp/models/occamy-1.0/mmproj-occamy-1.0-F16.gguf + uri: https://huggingface.co/Accio-Lab/occamy-1.0-GGUF/resolve/e8fe5e28e1b1c1f0cd0a39b85b16b631f17ca14e/mmproj-occamy-1.0-F16.gguf + sha256: 8f827a1e495f23e987686a7f55c26064270502a5b6ee954a828f1aec0b2fd400 - &qwen3-6-35b-a3b-genesis-hermes-v7 name: "qwen3.6-35b-a3b-genesis-hermes-v7" url: "github:mudler/LocalAI/gallery/virtual.yaml@master"