mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-04-04 07:01:39 -04:00
Code Issues Packages Projects Releases Wiki Activity

Update GPU-acceleration.md

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
This commit is contained in:
Ettore Di Giacinto
2025-07-06 19:03:34 +02:00
committed by GitHub
parent 9589097252
commit 7e1f2657d5
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/content/docs/features/GPU-acceleration.md
View File

@@ -289,14 +289,14 @@ If using nvidia, follow the steps in the [CUDA](#cudanvidia-acceleration) sectio
### Container images
To use Vulkan, use the images with the `vulkan` tag, for example `{{< version >}}-vulkan-ffmpeg-core`.
To use Vulkan, use the images with the `vulkan` tag, for example `{{< version >}}-gpu-vulkan`.
#### Example
To run LocalAI with Docker and Vulkan, you can use the following command as an example:
```bash
docker run -p 8080:8080 -e DEBUG=true -v $PWD/models:/models localai/localai:latest-vulkan-ffmpeg-core
docker run -p 8080:8080 -e DEBUG=true -v $PWD/models:/models localai/localai:latest-gpu-vulkan
```
### Notes
@@ -311,5 +311,5 @@ If you have mixed hardware, you can pass flags for multiple GPUs, for example:
docker run -p 8080:8080 -e DEBUG=true -v $PWD/models:/models \
--gpus=all \ # nvidia passthrough
--device /dev/dri --device /dev/kfd \ # AMD/Intel passthrough
localai/localai:latest-vulkan-ffmpeg-core
localai/localai:latest-gpu-vulkan
```