Strix Halo 8060S (Vulkan AMDVLK) dots1 UD-Q4_K_XL: tg128 decode tok/s
22.1 tok/s (tg128, per-request batch-1)
Fields
id
benchmarks/strix-halo-8060s-dots1-udq4-amdvlk-tg128Metric
decode_tok_s
Value
22.1
Unit
tok/s (tg128, per-request batch-1)
Model
dots1
Methodology
THIRD-PARTY MEASURED (lhl/strix-halo-testing llm-bench summary table). Hardware: Framework Desktop, AMD Ryzen AI Max+ 395 (Strix Halo) + Radeon 8060S iGPU, 128GB LPDDR5x-8000 unified memory. llama.cpp ~b5863, Vulkan AMDVLK backend, flags fa=1; llama-bench -fa 1 --mmap 0 -ngl 99, pp512 + tg128, per-request batch-1. Peak resident 84082 MiB. Numbers verbatim from the best-backend summary table.
Measured by
third_party
Reproducible
yes