AMD developer - 'llama.cpp on AMD EPYC: ZenDNN backend' (EPYC 9755 128c benchmarks)
blog
Fields
id
sources/amd-llama-cpp-on-amd-epyc-zendnn-9755Publisher
AMD
Kind
blog
Published
2026-08-18
Accessed
2026-10-14
notes
AMD vendor blog (ZD-066/067/068). EPYC 9755 128c single socket pinned (one NUMA node), ZenDNN 5.2.2 vs native CPU backend on llama.cpp b9326. llama-batched-bench 512in/128out/128seq, 3-run mean, flash-attn on, AOCL-DLP. Up to 4.5x prefill Mixtral-8x7B Q8_0, ~2x dense. Decode falls back to CPU path. WikiText-2 PPL delta <=0.0004.
Notes
AMD vendor blog (ZD-066/067/068). EPYC 9755 128c single socket pinned (one NUMA node), ZenDNN 5.2.2 vs native CPU backend on llama.cpp b9326. llama-batched-bench 512in/128out/128seq, 3-run mean, flash-attn on, AOCL-DLP. Up to 4.5x prefill Mixtral-8x7B Q8_0, ~2x dense. Decode falls back to CPU path. WikiText-2 PPL delta <=0.0004.
Cross-references
This record references no other records.