inference/research
verifiedlow · 0.60updated 2026-10-16

RTX 4060 Ti 16GB llama.cpp: gpt-oss 20B MXFP4 prefill at 128k ctx (Hardware Corner)

780.2 tok/s prompt processing, batch 1, per-request, ctx 128k

Fields

id
benchmarks/hc-4060ti-gptoss-20b-mxfp4-128k-pp
Metric
prefill_tok_s
Value
780.2
Unit
tok/s prompt processing, batch 1, per-request, ctx 128k
Model
gpt-oss 20B
Methodology
Hardware Corner per-GPU context-tier table (March 2026 update), single RTX 4060 Ti 16GB, llama.cpp GGUF, batch-1 per-request. gpt-oss 20B MXFP4, context depth 128k. Prefill column is prompt-processing tok/s; generation column is decode tok/s. NOT an aggregate across concurrent requests. The page does not reprint the llama-bench build hash (the site's sibling ranking page pins CUDA 12.8 / Q4_K_XL).
Measured by
third_party
Reproducible
yes
notes
Paired generation cell is recorded separately. Context is the tier the page groups into, not a llama-bench -d argument.

Notes

Paired generation cell is recorded separately. Context is the tier the page groups into, not a llama-bench -d argument.

Cross-references