A100 40GB PCIe llama.cpp b9935: Qwen3.6-35B-A3B UD-Q4_K_XL (MoE) prefill
3413 tok/s prefill (ctx 0.5k, FA on); decode 136 t/s tg128
Fields
id
benchmarks/llamabench-a100pcie40-qwen36-35b-a3b-q4kxl-ppMetric
prefill_tok_s
Value
3,413
Unit
tok/s prefill (ctx 0.5k, FA on); decode 136 t/s tg128
Model
Qwen3.6-35B-A3B UD-Q4_K_XL (MoE)
Methodology
llamabench.ai community row, reporter @wmeddie: llama.cpp build b9935, flash-attention on, KV cache f16, 0.5k context depth, no speculative decoding. Decode = tg128 single-stream (per-request, batch-1); prefill = site-reported figure. n=1 per model row — crowd-sourced, not a curated scoreboard.
Measured by
third_party