mirror of
https://github.com/mudler/LocalAI.git
synced 2026-09-21 13:44:55 -04:00
On shared-memory AMD APUs (e.g. Strix Halo), rocm-smi VRAM is only the BIOS UMA carve-out while usable HIP memory lives in GTT. Query --showmeminfo all and fold GTT when the VRAM/GTT ratio matches an APU, preserving dedicated dGPU accounting. Fixes #12058 Signed-off-by: lei_lei <imleilei123@gmail.com>