fix(qwen-tts): restore CUDA 13 SDPA fallback (#12067)

The CUDA 13 profile resolves PyTorch 2.14. Its headers cannot build the
current FlashAttention source release under C++17, so the full backend
matrix cannot publish the image.

Leave FlashAttention optional on CUDA 13. The backend already retries
model loading with SDPA when FlashAttention is unavailable.

Assisted-by: Codex:gpt-5

Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
localai-org-maint-botandEttore Di Giacinto authored and GitHub committed 2026-09-15 15:30:23 +02:00
1 parent d5256a5584
commit 5a24c8a2a2
3 files changed
-18

No files matched your search

-7
View File
@@ -10,11 +10,4 @@ else
source $backend_dir/../common/libbackend.sh
fi
# CUDA 13 has no prebuilt FlashAttention wheel, so the fallback source build
# exceeds the CI runner's memory when ninja compiles multiple units at once.
if [ "x${BUILD_PROFILE}" = "xcublas13" ]; then
export MAX_JOBS="${MAX_JOBS:-1}"
export NVCC_THREADS="${NVCC_THREADS:-1}"
fi
installRequirements
@@ -1,2 +0,0 @@
ninja
flash-attn
-9
View File
@@ -2,15 +2,6 @@
set -e
backend_dir=$(dirname $0)
for cuda_version in 12 13; do
grep -qx "flash-attn" "$backend_dir/requirements-cublas${cuda_version}-after.txt"
done
grep -q 'BUILD_PROFILE.*cublas13' "$backend_dir/install.sh"
grep -q 'MAX_JOBS.*1' "$backend_dir/install.sh"
grep -q 'NVCC_THREADS.*1' "$backend_dir/install.sh"
if [ -d $backend_dir/common ]; then
source $backend_dir/common/libbackend.sh
else