Files
LocalAI/gallery
mudler-agentandEttore Di Giacinto c677c3bbc2 feat(gallery): add Fluid Speech Mini GGUF for parakeet-cpp backend (#12672)
Fluid Speech Mini is a compact English dictation model by FluidVoice,
built on NVIDIA Parakeet TDT 0.6B v3 and Moondream Parakeet Ultra. It
matches Parakeet Ultra accuracy (4.53% WER on the Open ASR Leaderboard's
8 public English sets) at about a quarter of the download size (347 MB),
and is trained to keep transcribing the right speaker when another voice
is in the room.

The GGUF is a stock parakeet.cpp TDT checkpoint (Q2_K/Q4_K mixed
precision) that loads in the existing runtime on CPU and CUDA without
engine changes. Verified locally: parakeet-cli loads the model and
transcribes a test clip correctly.

Gallery entry uses the parakeet-cpp backend with the model file sourced
from huggingface://FluidVoice-Labs/fluid-speech-mini-gguf.

Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
2026-10-13 22:16:28 +02:00
..
2026-04-08 19:23:16 +02:00
2025-08-06 10:40:46 +02:00