mirror/LocalAI
1
0 Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-10-28 09:08:54 -04:00
Code Issues Packages Projects Releases Wiki Activity

feat(gallery): add Jumbo Fusion 27B variants

Browse Source 
Add pinned Q4_K_M and Q8_0 builds with linked variants and install docs.
Regenerate the gallery from the model library and fix its stale header.

Assisted-by: Codex:gpt-6

(cherry picked from commit 6b2e8ea09c, mudler/LocalAI#12857)
Assisted-by: Claude:claude-sonnet-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
localai-org-maint-bot authored and Ettore Di Giacinto committed 2026-10-25 09:55:40 +00:00
1 parent d747cf0798
commit 7ee537fffc
2 files changed
+136
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

gallery/index.yaml
+60
View File
@@ -3447,6 +3447,66 @@
model: Hemmingway-1.Q8_0.gguf
template:
use_tokenizer_template: true
- url: github:mudler/LocalAI/gallery/qwen3.yaml@master
name: qwen3.8-27b-jumbo-fusion-q4
description: |
DavidAU's Jumbo Fusion edition of Qwen3.8-27B merges community fine-tunes
and includes a custom template with reasoning and instruction modes.
This Q4_K_M GGUF build supports text chat with a 32,768-token default context.
license: apache-2.0
urls:
- https://huggingface.co/Qwen/Qwen3.8-27B
- https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF
tags:
- llm
- gguf
- cpu
- gpu
- reasoning
files:
- filename: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q4_K_M.gguf
sha256: 10110a2cb45cf827f8deb6c17946376691697080e4ea0e3ae1922a7dd06fc713
uri: https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF/resolve/63559b2ec40db5d17c383afb7e8574e038a1dc82/Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q4_K_M.gguf
overrides:
context_size: 32768
parameters:
min_p: 0.05
model: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q4_K_M.gguf
repeat_penalty: 1
temperature: 0.7
top_k: 64
top_p: 0.95
variants:
- model: qwen3.8-27b-jumbo-fusion-q8
- url: github:mudler/LocalAI/gallery/qwen3.yaml@master
name: qwen3.8-27b-jumbo-fusion-q8
description: |
DavidAU's Jumbo Fusion edition of Qwen3.8-27B merges community fine-tunes
and includes a custom template with reasoning and instruction modes.
This Q8_0 GGUF build supports text chat with a 32,768-token default context.
license: apache-2.0
urls:
- https://huggingface.co/Qwen/Qwen3.8-27B
- https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF
tags:
- llm
- gguf
- cpu
- gpu
- reasoning
files:
- filename: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q8_0.gguf
sha256: b18ae37279ebd34b92d2e15371cfe0a3aac490ccfc3f060ad9691c0aebfad6c1
uri: https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF/resolve/63559b2ec40db5d17c383afb7e8574e038a1dc82/Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q8_0.gguf
overrides:
context_size: 32768
parameters:
min_p: 0.05
model: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q8_0.gguf
repeat_penalty: 1
temperature: 0.7
top_k: 64
top_p: 0.95
- url: github:mudler/LocalAI/gallery/qwen3.yaml@master
name: qwen3.8-27b-turbo-brilliance-50x-q4
description: |
gallery/models/index.yaml
+76
View File
@@ -4072,6 +4072,82 @@
model: Hemmingway-1.Q8_0.gguf
template:
use_tokenizer_template: true
- kind: model
id: qwen3.8-27b-jumbo-fusion-q4
name: qwen3.8-27b-jumbo-fusion-q4
version: 1.0.0
description: |
DavidAU's Jumbo Fusion edition of Qwen3.8-27B merges community fine-tunes
and includes a custom template with reasoning and instruction modes.
This Q4_K_M GGUF build supports text chat with a 32,768-token default context.
license: apache-2.0
urls:
- https://huggingface.co/Qwen/Qwen3.8-27B
- https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF
tags:
- llm
- gguf
- cpu
- gpu
- reasoning
channel: gallery
policy:
requireSignature: false
schemaVersion: 1
model:
url: github:mudler/LocalAI/gallery/qwen3.yaml@master
files:
- filename: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q4_K_M.gguf
sha256: 10110a2cb45cf827f8deb6c17946376691697080e4ea0e3ae1922a7dd06fc713
uri: https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF/resolve/63559b2ec40db5d17c383afb7e8574e038a1dc82/Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q4_K_M.gguf
overrides:
context_size: 32768
parameters:
min_p: 0.05
model: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q4_K_M.gguf
repeat_penalty: 1
temperature: 0.7
top_k: 64
top_p: 0.95
variants:
- model: qwen3.8-27b-jumbo-fusion-q8
- kind: model
id: qwen3.8-27b-jumbo-fusion-q8
name: qwen3.8-27b-jumbo-fusion-q8
version: 1.0.0
description: |
DavidAU's Jumbo Fusion edition of Qwen3.8-27B merges community fine-tunes
and includes a custom template with reasoning and instruction modes.
This Q8_0 GGUF build supports text chat with a 32,768-token default context.
license: apache-2.0
urls:
- https://huggingface.co/Qwen/Qwen3.8-27B
- https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF
tags:
- llm
- gguf
- cpu
- gpu
- reasoning
channel: gallery
policy:
requireSignature: false
schemaVersion: 1
model:
url: github:mudler/LocalAI/gallery/qwen3.yaml@master
files:
- filename: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q8_0.gguf
sha256: b18ae37279ebd34b92d2e15371cfe0a3aac490ccfc3f060ad9691c0aebfad6c1
uri: https://huggingface.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF/resolve/63559b2ec40db5d17c383afb7e8574e038a1dc82/Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q8_0.gguf
overrides:
context_size: 32768
parameters:
min_p: 0.05
model: Qwen3.8-27B-Jumbo-FIQ-747-900-T-Brill-50X-NEO-MTP-Q8_0.gguf
repeat_penalty: 1
temperature: 0.7
top_k: 64
top_p: 0.95
- kind: model
id: qwen3.8-27b-turbo-brilliance-50x-q4
name: qwen3.8-27b-turbo-brilliance-50x-q4