Hardware Corner Mar-2026: nvidia-rtx-4080 llama.cpp Qwen3 8B Q4_K GGUF token generation 39.0 tok/s at 64k context
39.0 tok/s per-request decode (batch 1, ~65536-token context tier)
Fields
id
benchmarks/hwc26-rtx-4080-qwen3-8b-q4k-tg-64kMetric
decode_tok_s
Value
39
Unit
tok/s per-request decode (batch 1, ~65536-token context tier)
Model
Qwen3 8B Q4_K GGUF
Methodology
THIRD-PARTY MEASURED (hardware-corner.net /gpu-llm-benchmarks/rtx-4080/, page updated March 2026, accessed 2026-10-16). llama.cpp llama-bench, GGUF, single GPU, full offload. The page publishes prompt-processing tok/s and token-generation tok/s by context tier; it does not state the llama.cpp build, the prompt length, or the generation length. The page does not annotate flash attention for this model row. Value is the 64k context column. Per-request batch-1, NOT aggregate across concurrent requests.
Measured by
third_party
Reproducible
yes
notes
Context tier is the page bucket, not an exact measured token count. Page quant Q4_K maps to gguf-q4-k-m; page MXFP4 maps to gguf-mxfp4-moe. Distinct from the older Q4_K_XL rows sourced from hardware-corner-gpu-ranking-local-llm.
Notes
Context tier is the page bucket, not an exact measured token count. Page quant Q4_K maps to gguf-q4-k-m; page MXFP4 maps to gguf-mxfp4-moe. Distinct from the older Q4_K_XL rows sourced from hardware-corner-gpu-ranking-local-llm.