W7900 llama.cpp RADV: Qwen3.5-35B-A3B decode at 2.9K prompt (u/neuromacmd, commit 48cda24)
114.3 tok/s (single-request decode, batch 1, ~2.9K prompt)
Fields
id
benchmarks/nm-1s4bggo-w7900-35b-radv-q4km-2k9-tgMetric
decode_tok_s
Value
114.3
Unit
tok/s (single-request decode, batch 1, ~2.9K prompt)
Model
Qwen3.5-35B-A3B (unsloth UD-Q4_K_M, 21 GB)
Methodology
r/LocalLLaMA post 1s4bggo, EDIT 5. llama.cpp rebuilt at commit 48cda24 (2026-03-27) with the Vulkan backend, run on RADV (Mesa 25.3.6). Same unsloth GGUF, one request, batch size 1, prompt processing at the post's 2.9K prompt length, generation is single-request decode. NOT aggregate. These numbers supersede the AMDVLK numbers from the same post for the supported driver; both are kept because the post publishes both.
Measured by
third_party
Reproducible
yes
notes
EDIT 5 RADV retest at llama.cpp commit 48cda24, Mesa 25.3.6. Single GPU. The AMDVLK generation number from the same post is filed separately and is higher on the MoE model; the post says AMDVLK still wins generation on RDNA3/4 but is discontinued.
Notes
EDIT 5 RADV retest at llama.cpp commit 48cda24, Mesa 25.3.6. Single GPU. The AMDVLK generation number from the same post is filed separately and is higher on the MoE model; the post says AMDVLK still wins generation on RDNA3/4 but is discontinued.