NVIDIA RTX 5080 llama.cpp: gpt-oss 20B (MXFP4) token generation at 4k context
172.4 tok/s (tg4k, per-request batch-1)
Fields
id
benchmarks/hc26-5080-gptoss-20b-mxfp4-4k-tgMetric
decode_tok_s
Value
172.4
Unit
tok/s (tg4k, per-request batch-1)
Model
gpt-oss 20B (MXFP4)
Methodology
THIRD-PARTY MEASURED (Hardware Corner GPU LLM Benchmarks page, tables dated March 2026). llama.cpp llama-bench, GGUF, single GPU, batch-1. NVIDIA RTX 5080. gpt-oss 20B (MXFP4). Number is the 4k-context column of the Token Generation table: context depth the run was measured at, not a fixed pp512/tg128. Per-request, NOT aggregate. Page annotates llama.cpp build 8233 on this model.
Measured by
third_party
Reproducible
yes