inference/research
verifiedlow · 0.60updated 2026-10-16

Hardware Corner Mar-2026: nvidia-rtx-4070-ti-super llama.cpp gpt-oss-20B MXFP4 GGUF prompt processing 5628.1 tok/s at 4k context

5628.1 tok/s per-request prefill (batch 1, ~4096-token context tier)

Fields

id
benchmarks/hwc26-rtx-4070-ti-super-gptoss-20b-mxfp4-pp-4k
Metric
prefill_tok_s
Value
5,628.1
Unit
tok/s per-request prefill (batch 1, ~4096-token context tier)
Model
gpt-oss-20B MXFP4 GGUF
Methodology
THIRD-PARTY MEASURED (hardware-corner.net /gpu-llm-benchmarks/rtx-4070-ti-super/, page updated March 2026, accessed 2026-10-16). llama.cpp llama-bench, GGUF, single GPU, full offload. The page publishes prompt-processing tok/s and token-generation tok/s by context tier; it does not state the llama.cpp build, the prompt length, the generation length, or whether flash attention was enabled. Value is the 4k context column. Per-request batch-1, NOT aggregate across concurrent requests.
Measured by
third_party
Reproducible
yes
notes
Context tier is the page bucket, not an exact measured token count. Page quant Q4_K maps to gguf-q4-k-m; page MXFP4 maps to gguf-mxfp4-moe. Distinct from the older Q4_K_XL 16k-decode rows sourced from hardware-corner-gpu-ranking-local-llm.

Notes

Context tier is the page bucket, not an exact measured token count. Page quant Q4_K maps to gguf-q4-k-m; page MXFP4 maps to gguf-mxfp4-moe. Distinct from the older Q4_K_XL 16k-decode rows sourced from hardware-corner-gpu-ranking-local-llm.

Cross-references