feat(gallery): add Fluid Speech Mini GGUF for parakeet-cpp backend (#12672)

Fluid Speech Mini is a compact English dictation model by FluidVoice,
built on NVIDIA Parakeet TDT 0.6B v3 and Moondream Parakeet Ultra. It
matches Parakeet Ultra accuracy (4.53% WER on the Open ASR Leaderboard's
8 public English sets) at about a quarter of the download size (347 MB),
and is trained to keep transcribing the right speaker when another voice
is in the room.

The GGUF is a stock parakeet.cpp TDT checkpoint (Q2_K/Q4_K mixed
precision) that loads in the existing runtime on CPU and CUDA without
engine changes. Verified locally: parakeet-cli loads the model and
transcribes a test clip correctly.

Gallery entry uses the parakeet-cpp backend with the model file sourced
from huggingface://FluidVoice-Labs/fluid-speech-mini-gguf.

Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
mudler-agentandEttore Di Giacinto authored and GitHub committed 2026-10-13 22:16:28 +02:00
1 parent f02d5244da
commit c677c3bbc2
1 file changed
+32
+32
View File
@@ -59122,6 +59122,38 @@
- filename: parakeet-cpp/parakeet-bundle-moondream-redux.gguf
uri: huggingface://mudler/parakeet-cpp-gguf/parakeet-bundle-moondream-redux.gguf
sha256: d7c5bff66b1dbc02f4c7a83148b0836b57805676c844193c214c751249853d7b
- name: parakeet-cpp-fluid-speech-mini
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/FluidVoice-Labs/fluid-speech-mini-gguf
- https://github.com/mudler/parakeet.cpp
description: |
Fluid Speech Mini, a compact English dictation model by FluidVoice built on NVIDIA Parakeet TDT 0.6B v3
and Moondream Parakeet Ultra. Matches Parakeet Ultra accuracy (4.53% WER on Open ASR Leaderboard's
8 public English sets) at about a quarter of the download size (347 MB). Trained to keep transcribing
the right speaker when another voice is in the room. Q2_K/Q4_K mixed-precision GGUF for the parakeet-cpp
backend; loads in the stock parakeet.cpp runtime on CPU and CUDA.
license: cc-by-4.0
tags:
- parakeet
- parakeet-cpp
- asr
- speech-recognition
- stt
- dictation
- gguf
- ggml
overrides:
backend: parakeet-cpp
known_usecases:
- transcript
name: parakeet-cpp-fluid-speech-mini
parameters:
model: parakeet-cpp/fluid-speech-mini-q2k-q4k.gguf
files:
- filename: parakeet-cpp/fluid-speech-mini-q2k-q4k.gguf
uri: huggingface://FluidVoice-Labs/fluid-speech-mini-gguf/fluid-speech-mini-q2k-q4k.gguf
sha256: f0796bf40274cc49d3db58563c23cd024b52ca7e2ae4749ccf27af85841726b5
- name: moss-transcribe-cpp-0.9b
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls: