Strix Halo 8060S (HIP (TheRock ROCm 7.0.0-0, hipBLASLt)) Qwen3-30B-A3B UD-Q4_K_XL: tg128 at depth 16384
69.67 tok/s (tg128 at primed depth, per-request batch-1, 5-run average)
Fields
id
benchmarks/wiki-strix-8060s-qwen3-30b-a3b-udq4-hip-tg128-d16kMetric
decode_tok_s
Value
69.67
Unit
tok/s (tg128 at primed depth, per-request batch-1, 5-run average)
Model
Qwen3-30B-A3B (MoE, ~3B active)
Methodology
THIRD-PARTY MEASURED (Strix Halo HomeLab wiki llama.cpp performance page, lhl, re-fetched 2026-10-16). Hardware: Framework Desktop, AMD Ryzen AI Max+ 395 (Strix Halo) + Radeon 8060S iGPU (gfx1151), 128GB LPDDR5x unified memory. Model: unsloth Qwen3-30B-A3B-UD-Q4_K_XL.gguf. Backend: HIP (TheRock ROCm 7.0.0-0, hipBLASLt). llama-bench -fa 1 --mmap 0 -ngl 999 -ub 2048 -d 16384, five repeats, average tok/s. token-generation (tg128) measured at primed context depth 16384; per-request batch-1, not aggregate across concurrent requests. The wiki's zero-depth HIP tg128 (130.33) is the same shape as, but a different run from, the short-context HIP rocWMMA summary (58.5 tg128) already recorded in strix-halo-8060s-qwen3-30b-a3b-udq4-hip-tg128 — different llama.cpp build and backend flags, so both are kept.
Measured by
third_party
Reproducible
yes
Thermal state
unknown
notes
Per-request batch-1. Depth is the primed context (-d) before the pp512/tg128 measurement, not the generated length.
Notes
Per-request batch-1. Depth is the primed context (-d) before the pp512/tg128 measurement, not the generated length.