inference/research
verifiedlow · 0.60updated 2026-10-16

RTX 3080 Ti 12GB llama.cpp: Qwen3 14B Q4_K prefill at 16k ctx (Hardware Corner)

1773.9 tok/s prompt processing, batch 1, per-request, ctx 16k

Fields

id
benchmarks/hc-3080ti-qwen3-14b-q4k-16k-pp
Metric
prefill_tok_s
Value
1,773.9
Unit
tok/s prompt processing, batch 1, per-request, ctx 16k
Model
Qwen3 14B
Methodology
Hardware Corner per-GPU context-tier table (March 2026 update), single RTX 3080 Ti 12GB, llama.cpp GGUF, batch-1 per-request. Qwen3 14B Q4_K, context depth 16k. Prefill column is prompt-processing tok/s; generation column is decode tok/s. NOT an aggregate across concurrent requests. The page does not reprint the llama-bench build hash (the site's sibling ranking page pins CUDA 12.8 / Q4_K_XL).
Measured by
third_party
Reproducible
yes
notes
Paired generation cell already exists as a decode record at this context, not duplicated. Context is the tier the page groups into, not a llama-bench -d argument.

Notes

Paired generation cell already exists as a decode record at this context, not duplicated. Context is the tier the page groups into, not a llama-bench -d argument.

Cross-references