LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2026-02-28 12:47:53 -05:00

Files

LocalAI [bot] 5e13193d84 docs: add CDI driver config for NVIDIA GPU in containers (fix #8108 ) (#8677 )

This addresses issue #8108 where the legacy nvidia driver configuration
causes container startup failures with newer NVIDIA Container Toolkit versions.

Changes:
- Update docker-compose example to show both CDI (recommended) and legacy
  nvidia driver options
- Add troubleshooting section for 'Auto-detected mode as legacy' error
- Document the fix for nvidia-container-cli 'invalid expression' errors

The root cause is a Docker/NVIDIA Container Toolkit configuration issue,
not a LocalAI code bug. The error occurs during the container runtime's
prestart hook before LocalAI starts.

Co-authored-by: localai-bot <localai-bot@users.noreply.github.com>

2026-02-28 08:42:53 +01:00

_index.en.md

docs: add Podman installation documentation (#8646 )

2026-02-25 08:13:55 +01:00

build.md

chore: drop bark which is unmaintained (#8207 )

2026-01-25 09:26:40 +01:00

containers.md

docs: add CDI driver config for NVIDIA GPU in containers (fix #8108 ) (#8677 )

2026-02-28 08:42:53 +01:00

docker.md

docs: add Podman installation documentation (#8646 )