From c677c3bbc2d016a124f2b0cb84713cd748a84682 Mon Sep 17 00:00:00 2001 From: mudler-agent Date: Tue, 13 Oct 2026 22:16:28 +0200 Subject: [PATCH] feat(gallery): add Fluid Speech Mini GGUF for parakeet-cpp backend (#12672) Fluid Speech Mini is a compact English dictation model by FluidVoice, built on NVIDIA Parakeet TDT 0.6B v3 and Moondream Parakeet Ultra. It matches Parakeet Ultra accuracy (4.53% WER on the Open ASR Leaderboard's 8 public English sets) at about a quarter of the download size (347 MB), and is trained to keep transcribing the right speaker when another voice is in the room. The GGUF is a stock parakeet.cpp TDT checkpoint (Q2_K/Q4_K mixed precision) that loads in the existing runtime on CPU and CUDA without engine changes. Verified locally: parakeet-cli loads the model and transcribes a test clip correctly. Gallery entry uses the parakeet-cpp backend with the model file sourced from huggingface://FluidVoice-Labs/fluid-speech-mini-gguf. Co-authored-by: Ettore Di Giacinto --- gallery/index.yaml | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/gallery/index.yaml b/gallery/index.yaml index 20a7e0260..e6e31ab4c 100644 --- a/gallery/index.yaml +++ b/gallery/index.yaml @@ -59122,6 +59122,38 @@ - filename: parakeet-cpp/parakeet-bundle-moondream-redux.gguf uri: huggingface://mudler/parakeet-cpp-gguf/parakeet-bundle-moondream-redux.gguf sha256: d7c5bff66b1dbc02f4c7a83148b0836b57805676c844193c214c751249853d7b +- name: parakeet-cpp-fluid-speech-mini + url: github:mudler/LocalAI/gallery/virtual.yaml@master + urls: + - https://huggingface.co/FluidVoice-Labs/fluid-speech-mini-gguf + - https://github.com/mudler/parakeet.cpp + description: | + Fluid Speech Mini, a compact English dictation model by FluidVoice built on NVIDIA Parakeet TDT 0.6B v3 + and Moondream Parakeet Ultra. Matches Parakeet Ultra accuracy (4.53% WER on Open ASR Leaderboard's + 8 public English sets) at about a quarter of the download size (347 MB). Trained to keep transcribing + the right speaker when another voice is in the room. Q2_K/Q4_K mixed-precision GGUF for the parakeet-cpp + backend; loads in the stock parakeet.cpp runtime on CPU and CUDA. + license: cc-by-4.0 + tags: + - parakeet + - parakeet-cpp + - asr + - speech-recognition + - stt + - dictation + - gguf + - ggml + overrides: + backend: parakeet-cpp + known_usecases: + - transcript + name: parakeet-cpp-fluid-speech-mini + parameters: + model: parakeet-cpp/fluid-speech-mini-q2k-q4k.gguf + files: + - filename: parakeet-cpp/fluid-speech-mini-q2k-q4k.gguf + uri: huggingface://FluidVoice-Labs/fluid-speech-mini-gguf/fluid-speech-mini-q2k-q4k.gguf + sha256: f0796bf40274cc49d3db58563c23cd024b52ca7e2ae4749ccf27af85841726b5 - name: moss-transcribe-cpp-0.9b url: github:mudler/LocalAI/gallery/virtual.yaml@master urls: