inference/research
verifiedlow · 0.50updated 2026-10-17

r/LocalLLaMA: Qwen3.5 35B-A3B / 27B llama.cpp benches on R9700, W7900 and M5 Max (u/neuromacmd)

forum

Fields

id
sources/reddit-localllama-1s4bggo-amd-qwen35-llamacpp
Publisher
u/neuromacmd (r/LocalLLaMA)
Kind
forum
Published
2026-04-01
Accessed
2026-10-17
notes
Self-reported llama.cpp sweep, one post with five edits. Hardware stated in the post: Fedora 43 workstation with Radeon AI PRO R9700 32GB (gfx1201, PCIe Gen5 x16) and Radeon PRO W7900 48GB (gfx1100, PCIe Gen4 x16), Ryzen 9 9900X, 192 GB DDR5-5600; plus a MacBook Pro M5 Max 40-core GPU / 64 GB. Models are the same unsloth GGUF files on every machine: Qwen3.5-35B-A3B-UD-Q4_K_M.gguf (21 GB) and Qwen3.5-27B-Q4_K_M.gguf (16 GB). EDIT 3 re-ran the Mac on llama.cpp b8500 (Metal) with those exact GGUFs so the comparison is same-file; the original MLX 4-bit numbers are a different quant and are NOT transcribed here. EDIT 2 is the long-context sweep on the same models (context token counts printed in the table). EDIT 5 rebuilt llama.cpp at commit 48cda24 (2026-03-27) and retested RADV (Mesa 25.3.6) against AMDVLK; those cells are transcribed separately and the post itself says the AMDVLK and RADV generation numbers differ. Single self-report, kind=forum.

Notes

Self-reported llama.cpp sweep, one post with five edits. Hardware stated in the post: Fedora 43 workstation with Radeon AI PRO R9700 32GB (gfx1201, PCIe Gen5 x16) and Radeon PRO W7900 48GB (gfx1100, PCIe Gen4 x16), Ryzen 9 9900X, 192 GB DDR5-5600; plus a MacBook Pro M5 Max 40-core GPU / 64 GB. Models are the same unsloth GGUF files on every machine: Qwen3.5-35B-A3B-UD-Q4_K_M.gguf (21 GB) and Qwen3.5-27B-Q4_K_M.gguf (16 GB). EDIT 3 re-ran the Mac on llama.cpp b8500 (Metal) with those exact GGUFs so the comparison is same-file; the original MLX 4-bit numbers are a different quant and are NOT transcribed here. EDIT 2 is the long-context sweep on the same models (context token counts printed in the table). EDIT 5 rebuilt llama.cpp at commit 48cda24 (2026-03-27) and retested RADV (Mesa 25.3.6) against AMDVLK; those cells are transcribed separately and the post itself says the AMDVLK and RADV generation numbers differ. Single self-report, kind=forum.

Cross-references

This record references no other records.