Rockchip RK3588 NPU Qwen2.5-1.5B decode (w8a8)
16.7 tok/s (w8a8, 128-in/64-out)
Fields
id
benchmarks/comm-rk3588-qwen25-1p5b-decodeMetric
decode_tok_s
Value
16.7
Unit
tok/s (w8a8, 128-in/64-out)
Model
Qwen2.5-1.5B
Methodology
Vendor RKLLM benchmark table v1.3.1
Measured by
vendor
Thermal state
unknown