Strix Halo 8060S (HIP (ROCm)) Llama 4 Scout 17B-16E UD-Q4_K_XL: tg128 decode tok/s
17.6 tok/s (tg128, per-request batch-1)
Fields
id
benchmarks/strix-halo-8060s-llama4-scout-udq4-hip-tg128Metric
decode_tok_s
Value
17.6
Unit
tok/s (tg128, per-request batch-1)
Model
Llama 4 Scout 17B-16E
Methodology
THIRD-PARTY MEASURED (lhl/strix-halo-testing llm-bench summary table). Hardware: Framework Desktop, AMD Ryzen AI Max+ 395 (Strix Halo) + Radeon 8060S iGPU, 128GB LPDDR5x-8000 unified memory. llama.cpp ~b5863, HIP (ROCm) backend, flags hipBLASLt; llama-bench -fa 1 --mmap 0 -ngl 99, pp512 + tg128, per-request batch-1. Peak resident 59720 MiB. Numbers verbatim from the best-backend summary table.
Measured by
third_party
Reproducible
yes