inference/research
verifiedmedium · 0.70updated 2026-10-17

kyuz0 Strix Halo 8060S Ministral-3-14B-Instruct-2512-BF16 ROCm 7.2.3 64k tg32

6.14 tok/s

Fields

id
benchmarks/kyuz0-8060s-ministral-3-14b-instruct-2512-bf16-rocm723-64k-tg32
Metric
decode_tok_s
Value
6.14
Unit
tok/s
Model
Ministral-3-14B-Instruct-2512-BF16
Methodology
kyuz0 amd-strix-halo-toolboxes llama-bench sweep (results.json generated 2026-05-18, Fedora 43 kernel 6.19.12-200, llama.cpp build 1a68ec937 / b9193). ROCm 7.2.3, -fa 1 -ngl 99 --mmap 0. Long-context cell: context depth 65536 tokens, generation of 32 tokens. ONE request, batch size 1, so the number is per-request, not aggregate across concurrent requests. Mean of the repeated runs; std 0.0 tok/s. Model file 25.16 GiB, 13.51 B params, quant BF16.
Measured by
third_party
Reproducible
yes
notes
Not in the earlier kyuz0 filing, which covered only the default-context pp512/tg128 cells. Same results.json, the longctx32768 and longctx65536 rows.

Notes

Not in the earlier kyuz0 filing, which covered only the default-context pp512/tg128 cells. Same results.json, the longctx32768 and longctx65536 rows.

Cross-references