lhl/ggerganov: Strix Halo 8060S Vulkan AMDVLK (-ub512) Vulkan-AMDVLK gpt-oss-120b pp2048 137.08 t/s @32768
137.08 tok/s per-request prefill (batch 1, depth 32768)
Fields
id
benchmarks/lhl-strix-8060s-gpt-oss-120b-vulkan-amdvlk-pp2048-d32kMetric
prefill_tok_s
Value
137.08
Unit
tok/s per-request prefill (batch 1, depth 32768)
Model
gpt-oss-120b MXFP4/Q8 GGUF
Methodology
THIRD-PARTY MEASURED (lhl/strix-halo-testing README). llama.cpp build 6792; gpt-oss-120b (ggml-org MXFP4/Q8); pp2048/tg32 vs depth 0-32768. Spark numbers from ggerganov's llama.cpp discussion #16578 sweep (b6767); Strix Halo numbers lhl on Framework Desktop, TheRock/ROCm 7.10.0a20251017. Per-request batch-1. Strix Halo 8060S Vulkan AMDVLK (-ub512)
Measured by
third_party
Reproducible
yes
notes
pp collapses at depth on Vulkan (-790.9% vs Spark per lhl's table); the long-context prefill wall is the Strix Halo weakness, not tg.
Notes
pp collapses at depth on Vulkan (-790.9% vs Spark per lhl's table); the long-context prefill wall is the Strix Halo weakness, not tg.