inference/research
verifiedmedium · 0.70updated 2026-10-15

lhl/ggerganov: Strix Halo 8060S ROCm stock rocWMMA (-ub2048) ROCm-rocWMMA gpt-oss-120b pp2048 1006.65 t/s @0

1006.65 tok/s per-request prefill (batch 1, depth 0)

Fields

id
benchmarks/lhl-strix-8060s-gpt-oss-120b-rocm-wmma-pp2048-d0
Metric
prefill_tok_s
Value
1,006.65
Unit
tok/s per-request prefill (batch 1, depth 0)
Model
gpt-oss-120b MXFP4/Q8 GGUF
Methodology
THIRD-PARTY MEASURED (lhl/strix-halo-testing README). llama.cpp build 6792; gpt-oss-120b (ggml-org MXFP4/Q8); pp2048/tg32 vs depth 0-32768. Spark numbers from ggerganov's llama.cpp discussion #16578 sweep (b6767); Strix Halo numbers lhl on Framework Desktop, TheRock/ROCm 7.10.0a20251017. Per-request batch-1. Strix Halo 8060S ROCm stock rocWMMA (-ub2048)
Measured by
third_party
Reproducible
yes

Cross-references

Accelerators (1)

Engine (1)

Format (1)