W7900 llama.cpp ROCm: Qwen3.5-35B-A3B decode at 8824 context (u/neuromacmd)
81.7 tok/s (single-request decode, batch 1, 8824-token context)
Fields
id
benchmarks/nm-1s4bggo-w7900-35b-rocm-ctx8824-tgMetric
decode_tok_s
Value
81.7
Unit
tok/s (single-request decode, batch 1, 8824-token context)
Model
Qwen3.5-35B-A3B (unsloth UD-Q4_K_M, 21 GB)
Methodology
r/LocalLLaMA post 1s4bggo, EDIT 2. llama.cpp long-context sweep of Qwen3.5-35B-A3B UD-Q4_K_M on Fedora 43. One request, batch size 1. The context column is the allocated context in tokens and both the PP and Gen columns are measured at that depth; the post does not separately print the generated-token count. NOT aggregate across concurrent requests. ROCm rows at 65K and above on the dual-GPU config required -np 1 after a KV-cache checkpoint memory-access fault. Single W7900. Backend: ROCm. Context depth: 8824 tokens.
Measured by
third_party
Reproducible
yes
notes
EDIT 2 single-GPU context sweep. Context column is the allocated context, not a separately logged generation length.
Notes
EDIT 2 single-GPU context sweep. Context column is the allocated context, not a separately logged generation length.