Hardware Corner: RTX A6000 48GB, llama.cpp CUDA, Qwen3 30B-A3B Q4_K_XL GGUF, decode 75.35 t/s @16k ctx
75.35 tok/s per-request decode (batch 1, ~16384-token context)
Fields
id
benchmarks/hwcorner-rtx-a6000-qwen3-30b-a3b-q4kxl-decode-16kMetric
decode_tok_s
Value
75.35
Unit
tok/s per-request decode (batch 1, ~16384-token context)
Model
Qwen3 30B-A3B Q4_K XL GGUF
Methodology
THIRD-PARTY MEASURED (hardware-corner.net Definitive GPU Ranking for LLMs, accessed 2026-10-15). llama.cpp llama-bench CUDA 12.8, Ubuntu 24.04, Q4_K_XL GGUF quants, decode tok/s per GPU per model at ~16K context. Per-request batch-1, NOT aggregate. Value is the 16K-context column.
Measured by
third_party
Reproducible
yes
notes
Single-card row at 16K context; same table publishes 32K/65K/131K context columns.
Notes
Single-card row at 16K context; same table publishes 32K/65K/131K context columns.