lhl/ggerganov: Strix Halo 8060S ROCm tuned-rocWMMA ROCm-rocWMMA-tuned gpt-oss-120b pp2048 977.22 t/s @0
977.22 tok/s per-request prefill (batch 1, depth 0)
Fields
id
benchmarks/lhl-strix-8060s-gpt-oss-120b-rocm-tuned-pp2048-d0Metric
prefill_tok_s
Value
977.22
Unit
tok/s per-request prefill (batch 1, depth 0)
Model
gpt-oss-120b MXFP4/Q8 GGUF
Methodology
THIRD-PARTY MEASURED (lhl/strix-halo-testing README). llama.cpp build 6792; gpt-oss-120b (ggml-org MXFP4/Q8); pp2048/tg32 vs depth 0-32768. Spark numbers from ggerganov's llama.cpp discussion #16578 sweep (b6767); Strix Halo numbers lhl on Framework Desktop, TheRock/ROCm 7.10.0a20251017. Per-request batch-1. Strix Halo 8060S ROCm tuned-rocWMMA
Measured by
third_party
Reproducible
yes