inference/research
contestedlow · 0.55updated 2026-10-17

RTX 3090 Ti llama.cpp: Qwen3 14B prefill at 16k (Hardware Corner per-card page)

1914.8 tok/s (prompt processing, per-request, batch 1)

Fields

id
benchmarks/hc26-3090ti-qwen3-14b-pp-16k
Metric
prefill_tok_s
Value
1,914.8
Unit
tok/s (prompt processing, per-request, batch 1)
Model
Qwen3 14B
Methodology
Hardware Corner per-card LLM benchmark page (March 2026 sweep). Same lab method as their RTX 5090 llama-bench series already ingested: llama.cpp llama-bench, Ubuntu 24.04, CUDA 12.8, Q4_K GGUF (gpt-oss 20B labeled MXFP4 on the page; filed under gguf-mxfp4-moe, the nearest schema format). Context depth 16k. Per-request, batch size 1, NOT aggregate across concurrent requests. The page does not print the llama.cpp commit or the exact prompt/output lengths; the sibling 5090 series used build 466c1911 with -fa 1 -ngl 99. That protocol is the likely one and is NOT asserted as measured on this card. Prompt processing 1914.8 tok/s.
Measured by
third_party
Reproducible
yes
notes
Transcribed from the Hardware Corner RTX 3090 Ti per-card page, not from the Dec 2025 ranking table (hardware-corner-gpu-ranking-local-llm). Where the two pages print the same cell they disagree — e.g. Qwen3 8B decode at 16k is 93.6 here and 126.94 on the ranking — so this record is status: contested rather than a replacement. 24 GB GDDR6X, 1,008 GB/s, 450 W. Page states Qwen3 32B Q4_K fits fully in VRAM at 16k context.

Notes

Transcribed from the Hardware Corner RTX 3090 Ti per-card page, not from the Dec 2025 ranking table (hardware-corner-gpu-ranking-local-llm). Where the two pages print the same cell they disagree — e.g. Qwen3 8B decode at 16k is 93.6 here and 126.94 on the ranking — so this record is status: contested rather than a replacement. 24 GB GDDR6X, 1,008 GB/s, 450 W. Page states Qwen3 32B Q4_K fits fully in VRAM at 16k context.

Cross-references