Files
LocalAI/gallery
mudler-agentandEttore Di Giacinto 00faf4ec26 feat(parakeet-cpp): Moondream Ultra and Redux gallery entries, VAD option, pin bump (#12455)
* chore(parakeet-cpp): bump parakeet.cpp to 11c1a0f

Picks up support for the Moondream Ultra and Redux models and the
VAD-segmented transcription entry point (C-API ABI is still 10).

Assisted-by: Claude:claude-sonnet-5-5

* feat(parakeet-cpp): add vad option for long-audio transcription

Models with a VAD head (Moondream Ultra and Redux) can cut long audio at
pauses. Setting vad:true in the model options routes offline
transcription through parakeet_capi_transcribe_path_json_vad. The symbol
is probed at startup like the other optional entry points, and vad:true
fails the load with a clear message when the library lacks it. A model
without a VAD head fails the request with the library's own message.
The option is off by default and does not affect streaming.

Also say in the load error that a packed ternary Redux model is CPU only,
because the library reports its refusal on a GPU backend through its log,
not through the C API.

Assisted-by: Claude:claude-sonnet-5-5

* feat(gallery): add Moondream Ultra and Redux for parakeet-cpp

Add five entries from the public parakeet-cpp GGUF repository: Ultra in
F16 and Q8_0, and Redux as packed ternary (CPU only, offline only) and
as dequantized F16 and Q8_0 (any backend). The entries enable vad:true so
long audio is cut at pauses. Checksums come from the repository's LFS
metadata. The weights are CC-BY-4.0.

Assisted-by: Claude:claude-sonnet-5-5

* docs(parakeet-cpp): document Moondream Ultra, Redux and the vad option

Assisted-by: Claude:claude-sonnet-5-5

---------

Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
2026-10-03 22:08:12 +02:00
..
2026-04-08 19:23:16 +02:00
2025-08-06 10:40:46 +02:00