21ecc799e5
tests-qwen3-tts-cpp has been failing on master since 2026-07-31. The suite
loads every component fine and then stops: TTS() never returns from the
native call, so a job that takes ~5 minutes runs into the 20 minute Go test
timeout instead.
goroutine 74 [syscall, 19 minutes]:
github.com/ebitengine/purego.RegisterFunc.func4
qwen3-tts-cpp.(*Qwen3TtsCpp).TTS goqwen3ttscpp.go:154
qwen3-tts-cpp.init.func2.4 e2e_test.go:90
Not a flake: reproduced on master and again on an explicit re-run.
Bisected across this cycle's eight qwentts.cpp bumps by their own check:
10832, 10850, 10902, 10964, 11006, 11039 and 11127 all pass in ~5 minutes;
11241 (abab6b3) fails at 1h58m. That PR was merged with this check already
red, which is how the hang reached master.
35ebe537..abab6b3 is three upstream commits, and the only functional one is
26dd8adb, "predictor: unroll the frame into one cgraph and sample in standard
ops", which is consistent with a generation loop that never reaches its stop
condition.
Hold the pin at the last known-good commit. The bump entry is commented out
rather than left in place, because it tracks upstream master and would put
the hang straight back on the next nightly run. Both spots carry a pointer to
the other so the hold is discoverable, and restoring it is uncommenting four
lines once upstream is fixed.
Assisted-by: Claude Code:claude-opus-5 [Read] [Edit] [Bash]
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
Qwen3-TTS C++ backend
This backend runs Qwen3-TTS GGUF models through qwentts.cpp. It supports 24 kHz speech generation, streaming, named speakers, voice design, and reference-audio cloning depending on the model variant.
Gallery models
The following Base models accept LocalAI Voice Library profiles:
qwen3-tts-cppqwen3-tts-cpp-0.6b-base-q4qwen3-tts-cpp-1.7b-baseqwen3-tts-cpp-1.7b-base-q4
Gallery models containing customvoice or voicedesign implement those Qwen
modes instead and are not advertised as raw reference-audio models.
Install a Base model with:
local-ai models install qwen3-tts-cpp
Model configuration
Base filenames are detected automatically. Set tts.voice_cloning only when a
verified private conversion has a name that does not identify it as a Base or
VoiceClone model:
name: private-qwen-voice
backend: qwen3-tts-cpp
parameters:
model: qwen-private/talker.gguf
known_usecases:
- tts
tts:
voice_cloning: true
audio_path: voices/default-reference.wav # optional model-wide fallback
The tokenizer GGUF is auto-discovered when its filename contains tokenizer
and it is stored beside the talker. Otherwise set
options: ["tokenizer:qwen-private/tokenizer.gguf"].
tts.voice_cloning: false removes a model from Voice Library compatibility
results and rejects saved localai://voice-profiles/... references. It does
not disable Qwen's named-speaker or VoiceDesign modes. Setting it to true
cannot add cloning to a backend that lacks LocalAI's reference-audio contract.
Request precedence is: a request voice, then tts.voice, then
tts.audio_path. A saved profile supplies its private WAV and exact transcript
for that request without changing the model YAML.
API example
Create or select a profile in Operate → Voice Library, then pass its stable URI to either speech endpoint:
curl http://localhost:8080/v1/audio/speech \
-H 'Content-Type: application/json' \
-d '{
"model": "qwen3-tts-cpp",
"input": "This request uses a saved reference voice.",
"voice": "localai://voice-profiles/PROFILE_ID"
}' \
--output speech.wav
Native end-to-end test
The labeled test loads real GGUFs, synthesizes speech, streams audio, and exercises cloning with a generated 24 kHz reference WAV:
make -C backend/go/qwen3-tts-cpp qwen3-tts-cpp
QWEN3TTS_MODEL=/path/to/qwen-talker-0.6b-base-Q8_0.gguf \
QWEN3TTS_CODEC=/path/to/qwen-tokenizer-12hz-Q8_0.gguf \
QWEN3TTS_LIBRARY=backend/go/qwen3-tts-cpp/libgoqwen3ttscpp-fallback.so \
go test ./backend/go/qwen3-tts-cpp -ginkgo.label-filter=e2e