diff --git a/docs/content/features/model-gallery.md b/docs/content/features/model-gallery.md index a5af4a904..8098be575 100644 --- a/docs/content/features/model-gallery.md +++ b/docs/content/features/model-gallery.md @@ -158,6 +158,23 @@ frees. Removal then waits 30 seconds, during which you can undo it; the delete request is sent only when that time ends. If you leave the page during the wait, nothing is deleted. +## Mira v1.23 RLVR + +The gallery includes [Mira v1.23 RLVR](https://huggingface.co/Lambent/Mira-v1.23-27B-rlvr), +a Gemma 3 27B fine-tune for creative writing, roleplay, and problem-solving. +The llama.cpp entries include the matching F16 vision projector and use a +32,768-token context by default. The model uses the Gemma license. + +Install the Q4_K_M build explicitly: + +```bash +local-ai models install --variant mira-v1.23-27b-rlvr mira-v1.23-27b-rlvr +``` + +Use `--variant mira-v1.23-27b-rlvr-q8` for Q8_0. Without `--variant`, +LocalAI chooses a build based on available memory. Both builds use the +model's embedded chat template for text and image conversations. + ## Cyber-Ornith 1.5 9B Cyber-Ornith 1.5 is a Qwen3.5 fine-tune for security auditing, terminal tasks, and tool use. diff --git a/gallery/index.yaml b/gallery/index.yaml index 944c96774..1dce313a8 100644 --- a/gallery/index.yaml +++ b/gallery/index.yaml @@ -32271,6 +32271,80 @@ - filename: yanolja_YanoljaNEXT-Rosetta-12B-2510-Q4_K_M.gguf sha256: 7531456d8886419d36ce103b1205cdc820865016bddc0b4671ec9910ba87071f uri: huggingface://bartowski/yanolja_YanoljaNEXT-Rosetta-12B-2510-GGUF/yanolja_YanoljaNEXT-Rosetta-12B-2510-Q4_K_M.gguf +- name: mira-v1.23-27b-rlvr + variants: + - model: mira-v1.23-27b-rlvr-q8 + url: github:mudler/LocalAI/gallery/gemma.yaml@master + urls: + - https://huggingface.co/Lambent/Mira-v1.23-27B-rlvr + - https://huggingface.co/mradermacher/Mira-v1.23-27B-rlvr-GGUF + description: | + Mira v1.23 RLVR is a 27B Gemma 3 fine-tune trained on creative writing, + roleplay, and problem-solving scenarios. This Q4_K_M GGUF build includes + the F16 vision projector for image input and uses the embedded chat template. + license: gemma + tags: + - llm + - chat + - vision + - gemma + - gguf + - cpu + - gpu + overrides: + backend: llama-cpp + context_size: 32768 + mmproj: Mira-v1.23-27B-rlvr.mmproj-f16.gguf + options: + - use_jinja:true + template: + use_tokenizer_template: true + parameters: + model: Mira-v1.23-27B-rlvr.Q4_K_M.gguf + files: + - filename: Mira-v1.23-27B-rlvr.Q4_K_M.gguf + uri: https://huggingface.co/mradermacher/Mira-v1.23-27B-rlvr-GGUF/resolve/2aa3732dd7eee3c37f25d32cbc4b4341fa6fdf60/Mira-v1.23-27B-rlvr.Q4_K_M.gguf + sha256: 4de9289481a98bcf0f09a6967f06b758166bb31aca5f185cc6f54fb7a8954705 + - filename: Mira-v1.23-27B-rlvr.mmproj-f16.gguf + uri: https://huggingface.co/mradermacher/Mira-v1.23-27B-rlvr-GGUF/resolve/2aa3732dd7eee3c37f25d32cbc4b4341fa6fdf60/Mira-v1.23-27B-rlvr.mmproj-f16.gguf + sha256: f71c9725dfe77b30e578c153f4ae207c51a98dbf93990cc4b22c4c693cc5fe71 + +- name: mira-v1.23-27b-rlvr-q8 + url: github:mudler/LocalAI/gallery/gemma.yaml@master + urls: + - https://huggingface.co/Lambent/Mira-v1.23-27B-rlvr + - https://huggingface.co/mradermacher/Mira-v1.23-27B-rlvr-GGUF + description: | + Mira v1.23 RLVR is a 27B Gemma 3 fine-tune trained on creative writing, + roleplay, and problem-solving scenarios. This Q8_0 GGUF build includes + the F16 vision projector for image input and uses the embedded chat template. + license: gemma + tags: + - llm + - chat + - vision + - gemma + - gguf + - cpu + - gpu + overrides: + backend: llama-cpp + context_size: 32768 + mmproj: Mira-v1.23-27B-rlvr.mmproj-f16.gguf + options: + - use_jinja:true + template: + use_tokenizer_template: true + parameters: + model: Mira-v1.23-27B-rlvr.Q8_0.gguf + files: + - filename: Mira-v1.23-27B-rlvr.Q8_0.gguf + uri: https://huggingface.co/mradermacher/Mira-v1.23-27B-rlvr-GGUF/resolve/2aa3732dd7eee3c37f25d32cbc4b4341fa6fdf60/Mira-v1.23-27B-rlvr.Q8_0.gguf + sha256: 59d284c9b3e5b68adbdbd8c11d205ef9fdc6cda195edf569296e011dd5f9e432 + - filename: Mira-v1.23-27B-rlvr.mmproj-f16.gguf + uri: https://huggingface.co/mradermacher/Mira-v1.23-27B-rlvr-GGUF/resolve/2aa3732dd7eee3c37f25d32cbc4b4341fa6fdf60/Mira-v1.23-27B-rlvr.mmproj-f16.gguf + sha256: f71c9725dfe77b30e578c153f4ae207c51a98dbf93990cc4b22c4c693cc5fe71 + - name: mira-v1.7-27b-i1 url: github:mudler/LocalAI/gallery/gemma.yaml@master urls: