mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 17:18:49 -04:00
feat(gallery): add Fluid Speech Mini GGUF for parakeet-cpp backend (#12672)
Fluid Speech Mini is a compact English dictation model by FluidVoice, built on NVIDIA Parakeet TDT 0.6B v3 and Moondream Parakeet Ultra. It matches Parakeet Ultra accuracy (4.53% WER on the Open ASR Leaderboard's 8 public English sets) at about a quarter of the download size (347 MB), and is trained to keep transcribing the right speaker when another voice is in the room. The GGUF is a stock parakeet.cpp TDT checkpoint (Q2_K/Q4_K mixed precision) that loads in the existing runtime on CPU and CUDA without engine changes. Verified locally: parakeet-cli loads the model and transcribes a test clip correctly. Gallery entry uses the parakeet-cpp backend with the model file sourced from huggingface://FluidVoice-Labs/fluid-speech-mini-gguf. Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
1 parent
f02d5244da
commit
c677c3bbc2
1 file changed
+32
@@ -59122,6 +59122,38 @@
|
||||
- filename: parakeet-cpp/parakeet-bundle-moondream-redux.gguf
|
||||
uri: huggingface://mudler/parakeet-cpp-gguf/parakeet-bundle-moondream-redux.gguf
|
||||
sha256: d7c5bff66b1dbc02f4c7a83148b0836b57805676c844193c214c751249853d7b
|
||||
- name: parakeet-cpp-fluid-speech-mini
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
urls:
|
||||
- https://huggingface.co/FluidVoice-Labs/fluid-speech-mini-gguf
|
||||
- https://github.com/mudler/parakeet.cpp
|
||||
description: |
|
||||
Fluid Speech Mini, a compact English dictation model by FluidVoice built on NVIDIA Parakeet TDT 0.6B v3
|
||||
and Moondream Parakeet Ultra. Matches Parakeet Ultra accuracy (4.53% WER on Open ASR Leaderboard's
|
||||
8 public English sets) at about a quarter of the download size (347 MB). Trained to keep transcribing
|
||||
the right speaker when another voice is in the room. Q2_K/Q4_K mixed-precision GGUF for the parakeet-cpp
|
||||
backend; loads in the stock parakeet.cpp runtime on CPU and CUDA.
|
||||
license: cc-by-4.0
|
||||
tags:
|
||||
- parakeet
|
||||
- parakeet-cpp
|
||||
- asr
|
||||
- speech-recognition
|
||||
- stt
|
||||
- dictation
|
||||
- gguf
|
||||
- ggml
|
||||
overrides:
|
||||
backend: parakeet-cpp
|
||||
known_usecases:
|
||||
- transcript
|
||||
name: parakeet-cpp-fluid-speech-mini
|
||||
parameters:
|
||||
model: parakeet-cpp/fluid-speech-mini-q2k-q4k.gguf
|
||||
files:
|
||||
- filename: parakeet-cpp/fluid-speech-mini-q2k-q4k.gguf
|
||||
uri: huggingface://FluidVoice-Labs/fluid-speech-mini-gguf/fluid-speech-mini-q2k-q4k.gguf
|
||||
sha256: f0796bf40274cc49d3db58563c23cd024b52ca7e2ae4749ccf27af85841726b5
|
||||
- name: moss-transcribe-cpp-0.9b
|
||||
url: github:mudler/LocalAI/gallery/virtual.yaml@master
|
||||
urls:
|
||||
|
||||
Reference in new issue
Block a user