inference/research
verifiedlow · 0.60updated 2026-10-18

NVIDIA RTX 5090 llama.cpp: Qwen3.5 35B (MXFP4) token generation at 32k context

143.2 tok/s (tg32k, per-request batch-1)

Fields

id
benchmarks/hc26-5090-qwen35-35b-mxfp4-32k-tg
Metric
decode_tok_s
Value
143.2
Unit
tok/s (tg32k, per-request batch-1)
Model
Qwen3.5 35B (MXFP4)
Methodology
THIRD-PARTY MEASURED (Hardware Corner GPU LLM Benchmarks page, tables dated March 2026). llama.cpp llama-bench, GGUF, single GPU, batch-1. NVIDIA RTX 5090. Qwen3.5 35B (MXFP4). Number is the 32k-context column of the Token Generation table: context depth the run was measured at, not a fixed pp512/tg128. Per-request, NOT aggregate. The 4k and deepest-context cells of this model were already filed; this is a missing intermediate context column.
Measured by
third_party
Reproducible
yes
notes
Same page and protocol as the already-filed hc26-5090-qwen35-35b-mxfp4 cells. Raw llama-bench logs are not published.

Notes

Same page and protocol as the already-filed hc26-5090-qwen35-35b-mxfp4 cells. Raw llama-bench logs are not published.

Cross-references