id
gotchas/local-decode-benchmarks-for-the-priced-consumer-cards-what-exist
Symptom
Value research found sixteen accelerators that carry a purchase price but no local decode benchmark, which makes them unknowns rather than picks. For the consumer cards a buyer can actually acquire (RTX 3090, 3090 Ti, 4090, 4080, 5070 Ti, RX 9070 XT, Arc B580), the corpus could not say what any of them runs - only what they cost.
Root cause
No decode-throughput measurement for these parts had been ingested. The 2026-10-11 pass found usable figures for exactly TWO of the seven consumer cards and recorded them (local-rx9070xt-qwen3-8b-q4-decode-b1, local-arc-b580-r1-qwen-7b-q4-decode-b1, local-arc-b580-r1-qwen-14b-q4-decode-b1). The other five remain unsourced because no eligible source was found, NOT because a search was not run. It is better to record nothing than a wrong number, so the negative is the deliverable for them.
Workaround
SOURCES CHECKED, by card.\n\nSOURCED AND RECORDED:\n amd-radeon-rx-9070-xt (16GB) -> 96.7 tok/s decode, Ollama ROCm, Qwen3 8B Q4_K_M, batch 1 (Vulkan 102.0 in the same run). community repo with raw logs.\n intel-arc-b580 (12GB) -> 67.2 tok/s decode, llama.cpp Vulkan, R1-Distill-Qwen 7B Q4_K_M, batch 1; 35.6 tok/s on the 14B Q4_K_M. community llama-bench table.\n\nSTILL UNSOURCED - nothing eligible found:\n nvidia-rtx-3090 / nvidia-rtx-3090-ti The best candidate, sshJerry/llama-server-scripts, is a 2x-3090 rig and its figures are vLLM multi-GPU (Qwen3.8-27B solo decode 76-110 tok/s across BOTH cards), which RULE B of value-cheapest-usable-vram-and-what-it-actually-runs forbids filing under one card. No single-3090 batch-1 llama.cpp row was found in a citable repo/README.\n nvidia-rtx-4090 Search surfaced mostly SEO content farms (markaicode, smeltcore, localaimaster, bestllmfor) whose 'tok/s' figures have no primary log and are NOT citable; no repo README or forum post carrying a verbatim llama-bench/llama-server table was found in budget. The corpus's existing 4090 number remains the invalid RPC-cluster figure, correctly excluded.\n nvidia-rtx-4080 / nvidia-rtx-5070-ti no primary source located. Note both also have NO real price after the 2026-10-11 attribution fix (their only prices were mis-attributions from the RTX PRO 6000 and RTX 5090 records), so they are not even candidates yet.\n\nRULE FOR THE NEXT CRAWLER: accept only a verbatim llama-bench table, an r/LocalLLaMA post quoting the llama-server slot timing log, or a vendor throughput claim. A number on a blog with no command line and no raw data is not a benchmark, however plausible it looks.
notes
FILED 2026-10-11 (crawler/w17-dc-capex). Closes half of the corpus's biggest measured gap named in value-cheapest-usable-vram-and-what-it-actually-runs. NOTE ON measured_by: the benchmark schema allows only vendor/third_party/self, so the community/r/LocalLLaMA-style measurements ingested here are filed as 'third_party' with their community provenance stated in each record's notes - 'community' is NOT a valid value and would fail validation.\n\nPRICE CONTEXT: the RX 9070 XT and Arc B580 figures above are the ONLY priced consumer cards that now have both a real price AND a decode benchmark after the same day's price-attribution fix (RTX 4080 and RTX 5070 Ti lost their prices; RTX 3090/3090Ti/4090 still have no sourced decode figure). The B580 at ~$200 with 67.2 tok/s (7B) and the 9070 XT at ~$829-870 with 96.7 tok/s (8B) are the two consumer rows a buyer can now actually rank.