mirror of
https://github.com/mudler/LocalAI.git
synced 2026-07-30 18:09:05 -04:00
chore(moss-transcribe-cpp): bump pin to CUDA K-quant embed fix Bumps the moss-transcribe.cpp pin to 190a569c, which merges the host-side embed-lookup fallback for K-quant token_embd tensors (localai-org/moss-transcribe.cpp#2). Before this, running a q5_K/q4_K/q6_K moss-transcribe GGUF on CUDA (or any non-CPU backend) aborted in getrows.cu with "unsupported src0 type: q5_K" because ggml's GET_ROWS op has no K-quant implementation on GPU, killing the backend process on the first request. The engine now dequantizes the needed rows on the host when the backend cannot run GET_ROWS for the tensor type, producing bit-identical results. Fixes #10862 Assisted-by: Claude:claude-opus-4-8 [Bash] [Edit] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
@@ -1,6 +1,6 @@
|
||||
# moss-transcribe-cpp backend Makefile.
|
||||
#
|
||||
# Upstream pin lives below as MOSS_VERSION?=92a923dca88a41a34e47a364d55ee25731a9a0a2
|
||||
# Upstream pin lives below as MOSS_VERSION?=190a569c13b4b247450f2fb3b2a431244e84833e
|
||||
# (.github/bump_deps.sh) can find and update it - matches the
|
||||
# whisper.cpp / parakeet-cpp / ds4 convention.
|
||||
#
|
||||
@@ -15,7 +15,7 @@
|
||||
# That's what the L0 smoke test uses. The default target below does the proper
|
||||
# clone-at-pin + cmake build so CI doesn't need a side-checkout.
|
||||
|
||||
MOSS_VERSION?=92a923dca88a41a34e47a364d55ee25731a9a0a2
|
||||
MOSS_VERSION?=190a569c13b4b247450f2fb3b2a431244e84833e
|
||||
MOSS_REPO?=https://github.com/mudler/moss-transcribe.cpp
|
||||
|
||||
GOCMD?=go
|
||||
|
||||
Reference in New Issue
Block a user