RTX Pro 4000 Blackwell Ollama: Qwen2.5 32B eval rate (Computingforgeeks)

Computingforgeeks single-card Ollama comparison, published 2026-09-11, run on Ubuntu 26.04 with NVIDIA driver 580 and Ollama 0.11. Each card tested alone. Prompt is a fixed ~2,000-token document summarization request, output capped at 500 tokens, three runs averaged. The reported eval rate is decode tokens/s, per request, batch size 1, not an aggregate. Quantization is whatever `ollama pull` ships for the tag (page does not name the GGUF quant). RTX Pro 5000 Blackwell here is the 48 GB GDDR7 ECC card (32 GB model footprint fits); the 72 GB SKU is a different accelerator and was not tested. Card: RTX Pro 4000 Blackwell, 24 GB GDDR7 ECC. 32B model uses 19.4 GB, leaving little KV headroom.

Table cell Pro 4000 / qwen2.5:32b eval 24.6 tok/s, prompt eval 890 tok/s, VRAM 19.4 GB. qwen2.5:72b does not fit this card (page marks it as not fitting).