Strix Halo retained-PM4 llama-server Qwen3.8-Flash-Next MTP pp2048
1207.0 tok/s (per-request, parallel 1)
Fields
id
benchmarks/kyuz0-8060s-strixllama-qwen38-flash-next-mtp-pp2048Metric
prefill_tok_s
Value
1,207
Unit
tok/s (per-request, parallel 1)
Model
Qwen3.8-Flash-Next (shared MTP head)
Methodology
kyuz0 docs/building.md, retained-PM4 Strix Halo build named rocm-10.0-strix-llama. llama-server from halo-box/strix-llama.cpp with a custom ROCm runtime built from pwilkin/rocm-systems:ilintar-experiments. Flags: -dev ROCm0 -ngl all -fa on -fit off --load-mode none --lazy-mode on-direct -ctk f16 -ctv f16 -c 262144 -b 16384 -ub 16384 --parallel 1 --spec-type draft-mtp,ngram-mod --spec-draft-n-max 3. pp2048 at depth 0, speculative decoding on (draft MTP plus n-gram, draft-n-max 3). The page does not state the llama.cpp commit or the host RAM size. Per-request because --parallel 1.
Measured by
third_party
Reproducible
yes
notes
Prompt processing, pp2048 depth 0. Speculative decoding does not change the prefill figure much; the page quotes this as the measured number for the configuration.
Notes
Prompt processing, pp2048 depth 0. Speculative decoding does not change the prefill figure much; the page quotes this as the measured number for the configuration.