inference/research
verifiedhigh · 0.85updated 2026-10-03

llama.cpp issue #26208: ROCm backend allocates host RAM instead of VRAM on gfx1201

forum

Fields

id
sources/noncuda-llamacpp-26208-rocm-gfx1201-vram
Publisher
ggml-org/llama.cpp
Kind
forum
Published
2026-07-28
Accessed
2026-10-03
notes
8x RADEON AI Pro 9700 XT (gfx1201) on Debian with ROCm 7.11-7.14 and 10.1.0: nvtop shows no VRAM allocation at all, compute runs but reads weights over PCIe from host RAM; a 30 GB model at 256k context consumed over 256 GB of RAM. Reproduces with the official ROCm tarball builds and official build artifacts, and inside the official ROCm container, and is not fixed by any GGML_HIP_* build flag tried. Another user with 2x R9700 on Manjaro reports normal behaviour. Closed as not-reproducible-by-others, so the mechanism is still unknown.

Notes

8x RADEON AI Pro 9700 XT (gfx1201) on Debian with ROCm 7.11-7.14 and 10.1.0: nvtop shows no VRAM allocation at all, compute runs but reads weights over PCIe from host RAM; a 30 GB model at 256k context consumed over 256 GB of RAM. Reproduces with the official ROCm tarball builds and official build artifacts, and inside the official ROCm container, and is not fixed by any GGML_HIP_* build flag tried. Another user with 2x R9700 on Manjaro reports normal behaviour. Closed as not-reproducible-by-others, so the mechanism is still unknown.

Cross-references

This record references no other records.