inference/research
verifiedmedium · 0.65updated 2026-10-16

Hardware Corner: RTX 4070 Ti SUPER 16GB, llama.cpp CUDA, gpt-oss 20B MXFP4, token generation (tg) 128.9 t/s @4k ctx

128.9 tok/s per-request decode (batch 1, ~4096-token context)

Fields

id
benchmarks/hwcorner-rtx-4070-ti-super-gptoss-20b-mxfp4-tg-4k
Metric
decode_tok_s
Value
128.9
Unit
tok/s per-request decode (batch 1, ~4096-token context)
Model
gpt-oss 20B MXFP4
Methodology
THIRD-PARTY MEASURED (hardware-corner.net per-GPU LLM page, March 2026 update, accessed 2026-10-16). llama.cpp CUDA, single GPU, batch 1. RTX 4070 Ti SUPER 16GB, gpt-oss 20B MXFP4. Grid cell is token generation (tg) at the 4k-context column (~4096 tokens). Per-request, not summed across concurrent requests. Q4_K is the lab label; nearest repo format is gguf-q4-k-m. Prompt length inside the column is the context tier, not a separately published pp512.
Measured by
third_party
Reproducible
yes
notes
Context-sweep companion to the 16k decode rows from the same lab ranking page. Hero callouts that disagree with the grid (4070 Ti SUPER 84.3 t/s copies the PRO 5000 callout) are not used; this is the grid cell.

Notes

Context-sweep companion to the 16k decode rows from the same lab ranking page. Hero callouts that disagree with the grid (4070 Ti SUPER 84.3 t/s copies the PRO 5000 callout) are not used; this is the grid cell.

Cross-references