inference/research
verifiedlow · 0.60updated 2026-10-17

RTX PRO 2000 Blackwell vLLM: openai/gpt-oss-20b aggregate output throughput, 1000 requests

1037.61 tok/s (aggregate output tokens, 1000 concurrent)

Fields

id
benchmarks/dm-pro2000-vllm-gpt-oss-20b-c1000-out
Metric
tps_aggregate
Value
1,037.61
Unit
tok/s (aggregate output tokens, 1000 concurrent)
Model
gpt-oss-20b
Methodology
Database Mart vLLM bench on one RTX PRO 2000 Blackwell 16 GB GDDR7 ECC, 256 GB/s, 70 W. Model openai/gpt-oss-20b, quantization column '16' (bf16/fp16 not distinguished; format_id null, no fp16 record exists). vLLM commit not printed. Single GPU, tensor parallel 1. 1000 requests, input length 100 tokens, output length 600 tokens, benchmark duration 480.46 s, total input tokens 100000, total generated tokens 498526. AGGREGATE across the concurrent requests, not a per-request decode rate.
Measured by
third_party
Reproducible
yes
notes
First published LLM measurement for this SKU. Output (tokens/s) column.

Notes

First published LLM measurement for this SKU. Output (tokens/s) column.

Cross-references