inference/research
verifiedlow · 0.60updated 2026-10-16

Hardware Corner Mar-2026: nvidia-rtx-3090 llama.cpp Qwen3.5 35B MXFP4 GGUF prompt processing 2622.1 tok/s at 4k context

2622.1 tok/s per-request prefill (batch 1, ~4096-token context tier)

Fields

id
benchmarks/hwc26-rtx-3090-qwen35-35b-mxfp4-pp-4k
Metric
prefill_tok_s
Value
2,622.1
Unit
tok/s per-request prefill (batch 1, ~4096-token context tier)
Model
Qwen3.5 35B MXFP4 GGUF
Methodology
THIRD-PARTY MEASURED (hardware-corner.net /gpu-llm-benchmarks/rtx-3090/, page updated March 2026, accessed 2026-10-16). llama.cpp llama-bench, GGUF, single GPU, full offload. The page publishes prompt-processing tok/s and token-generation tok/s by context tier; it does not state the llama.cpp build, the prompt length, or the generation length. The page does not annotate flash attention for this model row. Value is the 4k context column. Per-request batch-1, NOT aggregate across concurrent requests.
Measured by
third_party
Reproducible
yes
notes
Context tier is the page bucket, not an exact measured token count. Page quant Q4_K maps to gguf-q4-k-m; page MXFP4 maps to gguf-mxfp4-moe. Distinct from the older Q4_K_XL rows sourced from hardware-corner-gpu-ranking-local-llm.

Notes

Context tier is the page bucket, not an exact measured token count. Page quant Q4_K maps to gguf-q4-k-m; page MXFP4 maps to gguf-mxfp4-moe. Distinct from the older Q4_K_XL rows sourced from hardware-corner-gpu-ranking-local-llm.

Cross-references