Strix Halo 8060S Vulkan RADV LFM2.5-1.2B-Instruct BF16 depth-0 decode
74.4867 tok/s
Fields
id
benchmarks/llmb-8060s-vulkan-lfm25-1-2b-bf16-d0-decodeMetric
decode_tok_s
Value
74.4867
Unit
tok/s
Model
LFM2.5-1.2B-Instruct BF16
Methodology
Protocol deterministic-prime-extend-completions-v1, runner local-llm-speed v1, measured at the API endpoint of an OpenAI-completions server. Mean of 2 repeats after 1 warmup. Depth 0: no primed prefix, so the whole prompt is computed. Follow-up prompt 2048 tokens, 128 generated tokens, KV cache type default, speculative decoding off. Prefill is effective follow-up prompt processing: uncached tokens divided by client-observed time to first output. Decode is client-observed generation throughput over the tokens after the first, so TTFT is excluded. Run run-d5739a4b996496f5, completed 2026-09-02. Hardware: AMD Ryzen AI Max+ 395, Radeon 8060S iGPU (Strix Halo). llama.cpp, backend Vulkan RADV, container image llama-vulkan-radv. Weights: model source not named in the export file LFM2.5-1.2B-Instruct-BF16.gguf. Per-request, concurrency 1, not aggregate.
Measured by
third_party
Reproducible
yes
notes
Concurrency 1 is one request, so the figure is per-request. The same run also measured concurrency 4, 8 and 16; those are aggregate and are not recorded here. Not comparable with the repo llama-bench pp512/tg128 rows: different prompt length and a server endpoint rather than llama-bench. Small dense model, useful as a bandwidth ceiling check against the 35B MoE rows on the same box.
Notes
Concurrency 1 is one request, so the figure is per-request. The same run also measured concurrency 4, 8 and 16; those are aggregate and are not recorded here. Not comparable with the repo llama-bench pp512/tg128 rows: different prompt length and a server endpoint rather than llama-bench. Small dense model, useful as a bandwidth ceiling check against the 35B MoE rows on the same box.