RTX PRO 5000 Blackwell vLLM: google/gemma-3-12b-it aggregate output throughput, 1000 requests
1706.59 tok/s (aggregate output tokens, 1000 concurrent)
Fields
id
benchmarks/dm-pro5000-vllm-gemma-3-12b-it-c1000-outMetric
tps_aggregate
Value
1,706.59
Unit
tok/s (aggregate output tokens, 1000 concurrent)
Model
gemma-3-12b-it
Methodology
Database Mart vLLM bench on one RTX PRO 5000 Blackwell 48 GB GDDR7 ECC (Server Edition, not the 72 GB workstation SKU). Model google/gemma-3-12b-it, quantization column '16' (bf16/fp16 not distinguished; format_id null, no fp16 record exists). vLLM commit not printed. Single GPU, tensor parallel 1. 1000 requests, input length 100 tokens, output length 600 tokens, benchmark duration 291.36 s, total input tokens 100000, total generated tokens 497150. AGGREGATE across the concurrent requests, not a per-request decode rate.
Measured by
third_party
Reproducible
yes
notes
Output (tokens/s) column. Aggregate across 1000 requests, not the per-request eval rate.
Notes
Output (tokens/s) column. Aggregate across 1000 requests, not the per-request eval rate.