RK3588 RKLLM Qwen2-0.5B decode (w8a8)
41.6 tok/s decode (w8a8, 128-in/64-out)
Fields
id
benchmarks/comm-rk3588-qwen2-0p5b-decodeMetric
decode_tok_s
Value
41.6
Unit
tok/s decode (w8a8, 128-in/64-out)
Model
Qwen2-0.5B
Methodology
Vendor RKLLM benchmark table (rknn-llm benchmark.md), RK3588 NPU, w8a8 quantisation, ISL=128/OSL=64
Measured by
vendor
Thermal state
unknown
notes
VENDOR-MEASURED. Largest model in the table is ChatGLM3-6B at ~5 tok/s; a real 7B lands ~3-4 tok/s est.
Notes
VENDOR-MEASURED. Largest model in the table is ChatGLM3-6B at ~5 tok/s; a real 7B lands ~3-4 tok/s est.