lhl 8060S llama-2-7b.Q4_K_M ROCm tg1 decode
41.29 tok/s
Fields
id
benchmarks/lhl-8060s-llama-2-7bq4-k-m-rocm-tg1Metric
decode_tok_s
Value
41.29
Unit
tok/s
Model
llama-2-7b.Q4_K_M
Methodology
lhl strix-halo-testing llm-bench (github.com/lhl/strix-halo-testing, llama-2-7b.Q4_K_M/results.jsonl). llama.cpp llama.cpp-hip, backend ROCm, no -fa, ngl=99, tg1 batch-1 decode at depth 0 on Ryzen AI Max+ 395 (Radeon 8060S gfx1151). System RAM peak 13973MiB, avg power 63W, max temp 52.0C. Per-request batch-1.
Measured by
third_party
Reproducible
yes