RTX Pro 5000 Blackwell Ollama: Qwen2.5 72B eval rate (Computingforgeeks)
18.4 tok/s (eval rate, per-request)
Fields
id
benchmarks/cfgk-pro5000-ollama-qwen25-72b-evalMetric
decode_tok_s
Value
18.4
Unit
tok/s (eval rate, per-request)
Model
qwen2.5:72b
Methodology
Computingforgeeks single-card Ollama comparison, published 2026-09-11, run on Ubuntu 26.04 with NVIDIA driver 580 and Ollama 0.11. Each card tested alone. Prompt is a fixed ~2,000-token document summarization request, output capped at 500 tokens, three runs averaged. The reported eval rate is decode tokens/s, per request, batch size 1, not an aggregate. Quantization is whatever `ollama pull` ships for the tag (page does not name the GGUF quant). RTX Pro 5000 Blackwell here is the 48 GB GDDR7 ECC card (32 GB model footprint fits); the 72 GB SKU is a different accelerator and was not tested. 72B uses 42 GB of the 48 GB card.
Measured by
third_party
Reproducible
yes
notes
Table cell Pro 5000 / qwen2.5:72b eval 18.4 tok/s, prompt eval 610 tok/s, VRAM 42 GB. Does not fit the 24 GB Pro 4000. Same card class as Database Mart llama3.3:70b at 21.42 tok/s; different model, so both are kept.
Notes
Table cell Pro 5000 / qwen2.5:72b eval 18.4 tok/s, prompt eval 610 tok/s, VRAM 42 GB. Does not fit the 24 GB Pro 4000. Same card class as Database Mart llama3.3:70b at 21.42 tok/s; different model, so both are kept.