LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2026-06-06 15:56:06 -04:00

Files

LocalAI [bot] 0e6712f734 chore: ⬆️ Update mudler/parakeet.cpp to 843600590f96a31467a5199f827c253f34c110f7 (#10198 )

chore(parakeet-cpp): bump pin to banded long-audio attention (843600590)

Update PARAKEET_VERSION to mudler/parakeet.cpp@843600590f
(merge of parakeet.cpp#9). Brings NeMo rel_pos_local_attn banded/Longformer
attention with the chunk-matmul construction: long audio now uses O(T*window)
attention instead of global O(T^2), fixing the encoder OOM on long clips
(~16.6-min clip: 54GB->9.4GB peak, ~4x faster) at NeMo's full [128,128] window.
Short clips are unchanged (global path). No C-ABI change.


Assisted-by: Claude:claude-opus-4-8

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-06 09:25:25 +02:00

.gitignore

feat(parakeet-cpp): add NVIDIA NeMo Parakeet ASR backend (parakeet.cpp) (#10084 )

2026-05-30 14:46:10 +02:00

batcher_test.go

feat(parakeet-cpp): dynamic batching for concurrent transcription requests (#10112 )

2026-06-02 14:49:02 +02:00

batcher.go

feat(parakeet-cpp): dynamic batching for concurrent transcription requests (#10112 )

2026-06-02 14:49:02 +02:00

goparakeetcpp_test.go

fix(parakeet-cpp): convert audio before the non-batched transcribe path (#10161 )