From 28ab73d4a17118b40a309c93f9b38f8df1346953 Mon Sep 17 00:00:00 2001 From: "LocalAI [bot]" <139863280+localai-bot@users.noreply.github.com> Date: Sat, 25 Oct 2025 17:23:43 +0200 Subject: [PATCH] chore(model gallery): :robot: add 1 new models via gallery agent (#6721) chore(model gallery): :robot: add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com> --- gallery/index.yaml | 57 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 57 insertions(+) diff --git a/gallery/index.yaml b/gallery/index.yaml index 5900442a2..059f35038 100644 --- a/gallery/index.yaml +++ b/gallery/index.yaml @@ -22542,3 +22542,60 @@ - filename: gpt-oss-20b-Esper3.1.i1-Q4_K_M.gguf sha256: 079683445913d12e70449a10b9e1bfc8adaf1e7917e86cf3be3cb29cca186f11 uri: huggingface://mradermacher/gpt-oss-20b-Esper3.1-i1-GGUF/gpt-oss-20b-Esper3.1.i1-Q4_K_M.gguf +- !!merge <<: *qwen3 + name: "almost-human-x3-32bit-1839-6b-i1" + urls: + - https://huggingface.co/mradermacher/Almost-Human-X3-32bit-1839-6B-i1-GGUF + description: | + **Model Name:** Almost-Human-X3-32bit-1839-6B + **Base Model:** Qwen3-Jan-v1-256k-ctx-6B-Brainstorm20x + **Author:** DavidAU + **Repository:** [DavidAU/Almost-Human-X3-32bit-1839-6B](https://huggingface.co/DavidAU/Almost-Human-X3-32bit-1839-6B) + **License:** Apache 2.0 + + --- + + ### 🔍 **Overview** + A high-precision, full-precision (float32) fine-tuned variant of the Qwen3-Jan model, specifically trained to emulate the literary and philosophical depth of Philip K. Dick. This model is the third in the "Almost-Human" series, built with advanced **"Brainstorm 20x"** methodology to enhance reasoning, coherence, and narrative quality—without sacrificing instruction-following ability. + + ### 🎯 **Key Features** + - **Full Precision (32-bit):** Trained at 16-bit for 3 epochs, then finalized at float32 for maximum fidelity and performance. + - **Extended Context (256k tokens):** Ideal for long-form writing, complex reasoning, and detailed code generation. + - **Advanced Reasoning via Brainstorm 20x:** The model’s reasoning centers are expanded, calibrated, and interconnected 20 times, resulting in: + - Richer, more nuanced prose + - Stronger emotional engagement + - Deeper narrative focus and foreshadowing + - Fewer clichés, more originality + - Enhanced coherence and detail + - **Optimized for Creativity & Code:** Excels at brainstorming, roleplay, storytelling, and multi-step coding tasks. + + ### 🛠️ **Usage Tips** + - Use **CHATML or Jinja templates** for best results. + - Recommended settings: Temperature 0.3–0.7 (higher for creativity), Top-p 0.8, Repetition penalty 1.05–1.1. + - Best used with **"smoothing" (1.5)** in GUIs like KoboldCpp or oobabooga. + - For complex tasks, use **Q6 or Q8 GGUF quantizations**. + + ### 📦 **Model Formats** + - **Full precision (safe tensors)** – for training or high-fidelity inference + - **GGUF, GPTQ, EXL2, AWQ, HQQ** – available via quantization (see [mradermacher/Almost-Human-X3-32bit-1839-6B-i1-GGUF](https://huggingface.co/mradermacher/Almost-Human-X3-32bit-1839-6B-i1-GGUF) for quantized versions) + + --- + + ### 💬 **Ideal For** + - Creative writing, speculative fiction, and philosophical storytelling + - Complex code generation with deep reasoning + - Roleplay, character-driven dialogue, and immersive narratives + - Researchers and developers seeking a highly expressive, human-like model + + > 📌 **Note:** This is the original source model. The GGUF versions by mradermacher are quantized derivatives — not the base model. + + --- + **Explore the source:** [DavidAU/Almost-Human-X3-32bit-1839-6B](https://huggingface.co/DavidAU/Almost-Human-X3-32bit-1839-6B) + **Quantization guide:** [mradermacher/Almost-Human-X3-32bit-1839-6B-i1-GGUF](https://huggingface.co/mradermacher/Almost-Human-X3-32bit-1839-6B-i1-GGUF) + overrides: + parameters: + model: Almost-Human-X3-32bit-1839-6B.i1-Q4_K_M.gguf + files: + - filename: Almost-Human-X3-32bit-1839-6B.i1-Q4_K_M.gguf + sha256: 5dc9766b505d98d7a5ad960b321c1fafe508734ca12ff4b7c480f8afbbc1e03b + uri: huggingface://mradermacher/Almost-Human-X3-32bit-1839-6B-i1-GGUF/Almost-Human-X3-32bit-1839-6B.i1-Q4_K_M.gguf