chore(model gallery): add flux 2 and flux 2 klein (#8141)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto
2026-01-21 09:46:33 +01:00
committed by GitHub
parent f6daaa7c35
commit b88ae31e4e

View File

@@ -13121,6 +13121,96 @@
- filename: t5xxl_fp16.safetensors
sha256: 6e480b09fae049a72d2a8c5fbccb8d3e92febeb233bbe9dfe7256958a9167635
uri: https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp16.safetensors
- !!merge <<: *flux
name: flux.2-dev
url: "github:mudler/LocalAI/gallery/flux-ggml.yaml@master"
description: |
FLUX.2 [dev] is a 32 billion parameter rectified flow transformer capable of generating, editing and combining images based on text instructions.
urls:
- https://huggingface.co/black-forest-labs/FLUX.2-dev
overrides:
step: 50
options:
- "diffusion_model"
- "vae_path:stablediffusion-cpp/models/flux2-vae.safetensors"
- "sampler:euler"
- llm_path:stablediffusion-cpp/models/Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf
- offload_params_to_cpu:true
cfg_scale: 1
parameters:
model: stablediffusion-cpp/models/flux2-dev-Q4_K_M.gguf
files:
- filename: "stablediffusion-cpp/models/flux2-dev-Q4_K_M.gguf"
sha256: "fca680c7b221a713b5cf7db6cf6b33474875320ee61f4c585bc33fe391dab9a6"
uri: "https://huggingface.co/city96/FLUX.2-dev-gguf/resolve/main/flux2-dev-Q4_K_M.gguf"
- filename: stablediffusion-cpp/models/flux2-vae.safetensors
sha256: d64f3a68e1cc4f9f4e29b6e0da38a0204fe9a49f2d4053f0ec1fa1ca02f9c4b5
uri: https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/vae/flux2-vae.safetensors
- filename: stablediffusion-cpp/models/Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf
sha256: a3cc56310807ed0d145eaf9f018ccda9ae7ad8edb41ec870aa2454b0d4700b3c
uri: https://huggingface.co/unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf
- !!merge <<: *flux
name: flux.2-klein-4b
url: "github:mudler/LocalAI/gallery/flux-ggml.yaml@master"
license: apache-2.0
description: |
The FLUX.2 [klein] model family are our fastest image models to date. FLUX.2 [klein] unifies generation and editing in a single compact architecture, delivering state-of-the-art quality with end-to-end inference in as low as under a second. Built for applications that require real-time image generation without sacrificing quality, and runs on consumer hardware, with as little as 13GB VRAM.
FLUX.2 [klein] 4B is a 4 billion parameter rectified flow transformer capable of generating images from text descriptions and supports multi-reference editing capabilities.
urls:
- https://huggingface.co/black-forest-labs/FLUX.2-klein-4B
overrides:
step: 4
options:
- "diffusion_model"
- "vae_path:stablediffusion-cpp/models/flux2-vae.safetensors"
- "sampler:euler"
- llm_path:stablediffusion-cpp/models/Qwen3-4B-Q4_K_M.gguf
- offload_params_to_cpu:true
cfg_scale: 1
parameters:
model: stablediffusion-cpp/models/flux-2-klein-4b-Q4_0.gguf
files:
- filename: "stablediffusion-cpp/models/flux-2-klein-4b-Q4_0.gguf"
sha256: "d1023499ef3f2f82ff7c50e6778495195c1b6cc34835741778868428111f9ff4"
uri: "https://huggingface.co/leejet/FLUX.2-klein-4B-GGUF/resolve/main/flux-2-klein-4b-Q4_0.gguf"
- filename: stablediffusion-cpp/models/flux2-vae.safetensors
sha256: d64f3a68e1cc4f9f4e29b6e0da38a0204fe9a49f2d4053f0ec1fa1ca02f9c4b5
uri: https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/vae/flux2-vae.safetensors
- filename: stablediffusion-cpp/models/Qwen3-4B-Q4_K_M.gguf
sha256: f6f851777709861056efcdad3af01da38b31223a3ba26e61a4f8bf3a2195813a
uri: https://huggingface.co/unsloth/Qwen3-4B-GGUF/resolve/main/Qwen3-4B-Q4_K_M.gguf
- !!merge <<: *flux
name: flux.2-klein-9b
url: "github:mudler/LocalAI/gallery/flux-ggml.yaml@master"
license: apache-2.0
description: |
The FLUX.2 [klein] model family are our fastest image models to date. FLUX.2 [klein] unifies generation and editing in a single compact architecture, delivering state-of-the-art quality with end-to-end inference in as low as under a second. Built for applications that require real-time image generation without sacrificing quality, and runs on consumer hardware, with as little as 13GB VRAM.
FLUX.2 [klein] 9B is a 9 billion parameter rectified flow transformer capable of generating images from text descriptions and supports multi-reference editing capabilities.
urls:
- https://huggingface.co/black-forest-labs/FLUX.2-klein-4B
overrides:
step: 4
options:
- "diffusion_model"
- "vae_path:stablediffusion-cpp/models/flux2-vae.safetensors"
- "sampler:euler"
- llm_path:stablediffusion-cpp/models/Qwen3-4B-Q4_K_M.gguf
- offload_params_to_cpu:true
cfg_scale: 1
parameters:
model: stablediffusion-cpp/models/flux-2-klein-9b-Q4_0.gguf
files:
- filename: "stablediffusion-cpp/models/flux-2-klein-9b-Q4_0.gguf"
sha256: "a7e77afa96871d16679ff7b949bd25f20c8179f219c4b662cac91e81ed99b944"
uri: "https://huggingface.co/leejet/FLUX.2-klein-9B-GGUF/resolve/main/flux-2-klein-9b-Q4_0.gguf"
- filename: stablediffusion-cpp/models/flux2-vae.safetensors
sha256: d64f3a68e1cc4f9f4e29b6e0da38a0204fe9a49f2d4053f0ec1fa1ca02f9c4b5
uri: https://huggingface.co/Comfy-Org/flux2-dev/resolve/main/split_files/vae/flux2-vae.safetensors
- filename: stablediffusion-cpp/models/Qwen3-4B-Q4_K_M.gguf
sha256: f6f851777709861056efcdad3af01da38b31223a3ba26e61a4f8bf3a2195813a
uri: https://huggingface.co/unsloth/Qwen3-4B-GGUF/resolve/main/Qwen3-4B-Q4_K_M.gguf
- &zimage
name: Z-Image-Turbo
icon: https://z-image.ai/logo.png