inference/research
verifiedlow · 0.60updated 2026-10-16

NVIDIA RTX 5090 llama.cpp: gpt-oss 20B (Q4_K) prompt processing at 4k context

9443.8 tok/s (pp4k, per-request batch-1)

Fields

id
benchmarks/hc26-5090-gptoss-20b-q4k-4k-pp
Metric
prefill_tok_s
Value
9,443.8
Unit
tok/s (pp4k, per-request batch-1)
Model
gpt-oss 20B (Q4_K)
Methodology
THIRD-PARTY MEASURED (Hardware Corner GPU LLM Benchmarks page, tables dated March 2026). llama.cpp llama-bench, GGUF, single GPU, batch-1. NVIDIA RTX 5090. gpt-oss 20B (Q4_K). Number is the 4k-context column of the Prompt Processing table: context depth the run was measured at, not a fixed pp512/tg128. Per-request, NOT aggregate.
Measured by
third_party
Reproducible
yes

Cross-references