mirror of
https://github.com/mudler/LocalAI.git
synced 2026-04-16 12:59:33 -04:00
ci(vllm): install libnuma1 + libgomp1 on bigger-runner
The vllm 0.14.1+cpu wheel ships a _C C++ extension that dlopens
libnuma.so.1 at import time. When the runner host doesn't have it,
the extension silently fails to register its torch ops, so
EngineCore crashes on init_device with:
AttributeError: '_OpNamespace' '_C_utils' object has no attribute
'init_cpu_threads_env'
Also add libgomp1 (OpenMP runtime, used by torch CPU kernels) to be
safe on stripped-down runners.
This commit is contained in:
8
.github/workflows/test-extra.yml
vendored
8
.github/workflows/test-extra.yml
vendored
@@ -519,11 +519,15 @@ jobs:
|
||||
- name: Dependencies
|
||||
# bigger-runner is a bare self-hosted runner — install the tools
|
||||
# we need for docker-build + protogen-go + go test (make, curl,
|
||||
# unzip for the protoc download, build-essential for cgo).
|
||||
# unzip for the protoc download, build-essential for cgo), plus
|
||||
# libnuma1 which the vllm CPU wheel's _C extension dlopens at
|
||||
# runtime (libnuma.so.1 missing → init_cpu_threads_env op is not
|
||||
# registered → AttributeError on LoadModel).
|
||||
run: |
|
||||
sudo apt-get update
|
||||
sudo apt-get install -y --no-install-recommends \
|
||||
make build-essential curl unzip ca-certificates git tar
|
||||
make build-essential curl unzip ca-certificates git tar \
|
||||
libnuma1 libgomp1
|
||||
- name: Setup Go
|
||||
uses: actions/setup-go@v5
|
||||
with:
|
||||
|
||||
Reference in New Issue
Block a user