RTX 3060 12GB llama.cpp: Qwen3 8B Q4_K prefill at 4k ctx (Hardware Corner)
1696.8 tok/s prompt processing, batch 1, per-request, ctx 4k
Fields
id
benchmarks/hc-3060-qwen3-8b-q4k-4k-ppMetric
prefill_tok_s
Value
1,696.8
Unit
tok/s prompt processing, batch 1, per-request, ctx 4k
Model
Qwen3 8B
Methodology
Hardware Corner per-GPU context-tier table (March 2026 update), single RTX 3060 12GB, llama.cpp GGUF, batch-1 per-request. Qwen3 8B Q4_K, context depth 4k. Prefill column is prompt-processing tok/s; generation column is decode tok/s. NOT an aggregate across concurrent requests. The page does not reprint the llama-bench build hash (the site's sibling ranking page pins CUDA 12.8 / Q4_K_XL).
Measured by
third_party
Reproducible
yes
notes
Paired generation cell is recorded separately. Context is the tier the page groups into, not a llama-bench -d argument.
Notes
Paired generation cell is recorded separately. Context is the tier the page groups into, not a llama-bench -d argument.