mirror/LocalAI
1
0 Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-10-28 09:08:54 -04:00
Code Issues Packages Projects Releases Wiki Activity

chore(gallery): add Simplicio-27B GGUF variants

Browse Source 
Offer Q4_K_M and Q8_0 builds with the matching vision projector.
Pin downloads and verify their SHA256 against Hugging Face metadata
and response headers. Document installation and variant selection.

Assisted-by: Codex:gpt-6

(cherry picked from commit 0e8ebcde37, mudler/LocalAI#12516)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
localai-org-maint-bot authored and Ettore Di Giacinto committed 2026-10-13 07:24:11 +00:00
1 parent c5375372b7
commit bb807d7ca2
1 file changed
+84
Download Patch File Download Diff File Expand all files Collapse all files
gallery/index.yaml
+84
View File
@@ -1,4 +1,88 @@
---
- name: simplicio-27b-q4
variants:
- model: simplicio-27b-q8
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/wesleysimplicio/Simplicio-27B
- https://huggingface.co/mradermacher/Simplicio-27B-GGUF
description: |
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering.
This Q4_K_M GGUF build uses llama.cpp and includes the F16 vision projector.
license: apache-2.0
tags:
- llm
- gguf
- cpu
- gpu
- coding
- vision
- multimodal
overrides:
backend: llama-cpp
context_size: 32768
function:
automatic_tool_parsing_fallback: true
grammar:
disable: true
known_usecases:
- chat
- vision
mmproj: llama-cpp/mmproj/Simplicio-27B/Simplicio-27B.mmproj-f16.gguf
options:
- use_jinja:true
parameters:
model: llama-cpp/models/Simplicio-27B-Q4_K_M/Simplicio-27B.Q4_K_M.gguf
template:
use_tokenizer_template: true
files:
- filename: llama-cpp/models/Simplicio-27B-Q4_K_M/Simplicio-27B.Q4_K_M.gguf
sha256: a13382b622b101a8e28df747d1fba476b563121251cbe8e569818c122e9f4600
uri: https://huggingface.co/mradermacher/Simplicio-27B-GGUF/resolve/e4269a7c2c770a15ef32a042bc0861642817f7ea/Simplicio-27B.Q4_K_M.gguf
- filename: llama-cpp/mmproj/Simplicio-27B/Simplicio-27B.mmproj-f16.gguf
sha256: 748cc53ee11b19221eb0cbb6c7fcb484199bc35eead8ed942280a81ae3840426
uri: https://huggingface.co/mradermacher/Simplicio-27B-GGUF/resolve/e4269a7c2c770a15ef32a042bc0861642817f7ea/Simplicio-27B.mmproj-f16.gguf
- name: simplicio-27b-q8
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/wesleysimplicio/Simplicio-27B
- https://huggingface.co/mradermacher/Simplicio-27B-GGUF
description: |
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering.
This Q8_0 GGUF build uses llama.cpp and includes the F16 vision projector.
license: apache-2.0
tags:
- llm
- gguf
- cpu
- gpu
- coding
- vision
- multimodal
overrides:
backend: llama-cpp
context_size: 32768
function:
automatic_tool_parsing_fallback: true
grammar:
disable: true
known_usecases:
- chat
- vision
mmproj: llama-cpp/mmproj/Simplicio-27B/Simplicio-27B.mmproj-f16.gguf
options:
- use_jinja:true
parameters:
model: llama-cpp/models/Simplicio-27B-Q8_0/Simplicio-27B.Q8_0.gguf
template:
use_tokenizer_template: true
files:
- filename: llama-cpp/models/Simplicio-27B-Q8_0/Simplicio-27B.Q8_0.gguf
sha256: 6f31929fa06110a61f3baf802efc4335ea7f4581ed2dc1bc562275bd5c45a454
uri: https://huggingface.co/mradermacher/Simplicio-27B-GGUF/resolve/e4269a7c2c770a15ef32a042bc0861642817f7ea/Simplicio-27B.Q8_0.gguf
- filename: llama-cpp/mmproj/Simplicio-27B/Simplicio-27B.mmproj-f16.gguf
sha256: 748cc53ee11b19221eb0cbb6c7fcb484199bc35eead8ed942280a81ae3840426
uri: https://huggingface.co/mradermacher/Simplicio-27B-GGUF/resolve/e4269a7c2c770a15ef32a042bc0861642817f7ea/Simplicio-27B.mmproj-f16.gguf
- name: "qwen-image-2.1"
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
urls: