R9700 Vulkan RADV Qwen3.6-35B-A3B UD-Q4_K_XL depth-0 decode
114.1852 tok/s
Fields
id
benchmarks/llmb-r9700-vulkan-qwen36-35b-a3b-q4kxl-d0-decodeMetric
decode_tok_s
Value
114.1852
Unit
tok/s
Model
Qwen3.6-35B-A3B UD-Q4_K_XL
Methodology
Protocol deterministic-prime-extend-completions-v1, runner local-llm-speed v1, measured at the API endpoint of an OpenAI-completions server. Mean of 2 repeats after 1 warmup. Depth 0: no primed prefix, so the whole prompt is computed. Follow-up prompt 2048 tokens, 128 generated tokens, KV cache type default, speculative decoding off. Prefill is effective follow-up prompt processing: uncached tokens divided by client-observed time to first output. Decode is client-observed generation throughput over the tokens after the first, so TTFT is excluded. Run run-884593eddcd1f0dc, completed 2026-09-02. Hardware: one AMD Radeon AI PRO R9700. llama.cpp, backend Vulkan RADV, container image r9700-llama-vulkan-radv. Weights: unsloth/Qwen3.6-35B-A3B-MTP-GGUF file Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf. Per-request, concurrency 1, not aggregate.
Measured by
third_party
Reproducible
yes
notes
Concurrency 1 is one request, so the figure is per-request. The same run also measured concurrency 4, 8 and 16; those are aggregate and are not recorded here. Not comparable with the repo llama-bench pp512/tg128 rows: different prompt length and a server endpoint rather than llama-bench.
Notes
Concurrency 1 is one request, so the figure is per-request. The same run also measured concurrency 4, 8 and 16; those are aggregate and are not recorded here. Not comparable with the repo llama-bench pp512/tg128 rows: different prompt length and a server endpoint rather than llama-bench.