Hardware Corner: RTX 3080 Ti 12GB, llama.cpp CUDA, Qwen3 14B Q4_K GGUF, prompt processing (pp) 2600.1 t/s @4k ctx
2600.1 tok/s per-request prompt processing (pp, ~4096-token context)
Fields
id
benchmarks/hwcorner-rtx-3080-ti-qwen3-14b-q4k-pp-4kMetric
prefill_tok_s
Value
2,600.1
Unit
tok/s per-request prompt processing (pp, ~4096-token context)
Model
Qwen3 14B Q4_K GGUF
Methodology
THIRD-PARTY MEASURED (hardware-corner.net per-GPU LLM page, March 2026 update, accessed 2026-10-16). llama.cpp CUDA, single GPU, batch 1. RTX 3080 Ti 12GB, Qwen3 14B Q4_K GGUF. Grid cell is prompt processing (pp) at the 4k-context column (~4096 tokens). Per-request, not summed across concurrent requests. Q4_K is the lab label; nearest repo format is gguf-q4-k-m. Prompt length inside the column is the context tier, not a separately published pp512.
Measured by
third_party
Reproducible
yes
notes
Context-sweep companion to the 16k decode rows from the same lab ranking page. Hero callouts that disagree with the grid (4070 Ti SUPER 84.3 t/s copies the PRO 5000 callout) are not used; this is the grid cell.
Notes
Context-sweep companion to the 16k decode rows from the same lab ranking page. Hero callouts that disagree with the grid (4070 Ti SUPER 84.3 t/s copies the PRO 5000 callout) are not used; this is the grid cell.