fix(gallery): default audio-cpp models to backend:best (#11892)

* fix(gallery): default audio-cpp models to backend:best

The audio-cpp engine creates its session on the CPU backend when no
backend option is given, so every gallery model ran CPU-only even on
machines where a CUDA/Vulkan/Metal device was registered. backend:best
selects the best available backend and falls back to CPU.

Assisted-by: Claude:claude-fable-5
Signed-off-by: Plamen K. Kosseff <p.kosseff@gmail.com>

* docs(audio-cpp): explain gallery device selection

Document automatic compute backend selection and the CPU override.

Assisted-by: Codex:gpt-6
Signed-off-by: Plamen K. Kosseff <p.kosseff@gmail.com>

---------

Signed-off-by: Plamen K. Kosseff <p.kosseff@gmail.com>
Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
This commit is contained in:
Plamen K. Kosseffandlocalai-org-maint-bot authored and GitHub committed 2026-09-08 08:45:17 +02:00
1 parent ba88fb13ce
commit e8546965c7
2 files changed
+31

No files matched your search

+5
View File
@@ -28,6 +28,11 @@ key stored *inside* the GGUF, which cannot be read from a remote repository, and
upstream GGUF repository hosts every family in one place. Set `backend: audio-cpp`
in the model YAML, or select it explicitly in the import form.
The bundled audio-cpp gallery entries set `backend:best` in `options` to select
an available compute backend, with CPU as the fallback. To force CPU execution,
replace that option with `backend:cpu`. Model configurations that omit this
option still default to CPU.
## What it serves
One model serves one family, and a family advertises the tasks it can perform. The
+26
View File
@@ -56579,6 +56579,8 @@
known_usecases:
- tts
name: audio-cpp-indextts-2.5
options:
- backend:best
parameters:
model: audio-cpp/index-tts2_5-orig.gguf
files:
@@ -56616,6 +56618,8 @@
known_usecases:
- tts
name: audio-cpp-supertonic
options:
- backend:best
parameters:
model: audio-cpp/supertonic-3-orig.gguf
files:
@@ -56658,6 +56662,8 @@
known_usecases:
- tts
name: audio-cpp-higgs-audio-v3
options:
- backend:best
parameters:
model: audio-cpp/higgs-audio-v3-tts-4b-q8_0.gguf
files:
@@ -56707,6 +56713,8 @@
- tts
- audio_transform
name: audio-cpp-chatterbox
options:
- backend:best
parameters:
model: audio-cpp/chatterbox-q8_0.gguf
files:
@@ -56743,6 +56751,8 @@
known_usecases:
- transcript
name: audio-cpp-citrinet-asr
options:
- backend:best
parameters:
model: audio-cpp/citrinet-asr-q8_0.gguf
files:
@@ -56779,6 +56789,8 @@
known_usecases:
- transcript
name: audio-cpp-nemotron-asr
options:
- backend:best
parameters:
model: audio-cpp/nemotron-3.5-asr-streaming-0.6b-f16.gguf
files:
@@ -56816,6 +56828,8 @@
known_usecases:
- diarization
name: audio-cpp-sortformer-diarization
options:
- backend:best
parameters:
model: audio-cpp/sortformer-diar-4spk-v1-q8_0.gguf
files:
@@ -56853,6 +56867,8 @@
known_usecases:
- audio_transform
name: audio-cpp-htdemucs
options:
- backend:best
parameters:
model: audio-cpp/htdemucs-f16.gguf
files:
@@ -56892,6 +56908,8 @@
known_usecases:
- sound_generation
name: audio-cpp-stable-audio-sfx
options:
- backend:best
parameters:
model: audio-cpp/stable-audio-3-small-sfx-q8_0.gguf
files:
@@ -56930,6 +56948,8 @@
known_usecases:
- transcript
name: audio-cpp-forced-aligner
options:
- backend:best
parameters:
language: en
model: audio-cpp/qwen3-forced-aligner-0.6b-q8_0.gguf
@@ -56959,6 +56979,7 @@
- vad
name: audio-cpp-silero-vad
options:
- backend:best
- family:silero_vad
parameters:
model: bundled:silero_vad
@@ -56986,6 +57007,7 @@
- vad
name: audio-cpp-marblenet-vad
options:
- backend:best
- family:marblenet_vad
parameters:
model: bundled:marblenet_vad
@@ -57025,6 +57047,8 @@
known_usecases:
- tts
name: audio-cpp-irodori-voicedesign
options:
- backend:best
parameters:
model: audio-cpp/irodori-tts-600m-v3-voicedesign-q8_0.gguf
files:
@@ -57069,6 +57093,7 @@
- audio_transform
name: audio-cpp-seedvc-singing
options:
- backend:best
- task:svc
parameters:
model: audio-cpp/seed-vc-mlx-q8_0.gguf
@@ -57121,6 +57146,7 @@
- audio_transform
name: audio-cpp-vevo2-speech-to-speech
options:
- backend:best
- task:s2s
parameters:
model: audio-cpp/vevo2-q8_0.gguf