NVIDIA GeForce RTX 5080
Fields
accelerators/nvidia-rtx-5080Notes
CORRECTED 2026-10-03: the dense FP8 row was 225.1, which is NVIDIA's 'FP8 with FP32 Accumulate' DENSE rate, not a sparse value - the row was mislabelled dense:false AND drew from the wrong of the two FP8 rows NVIDIA publishes. It is now 450.2 dense with 900.4 dense:false as its sparse twin, which is exactly the '450.2/900.42' pair on NVIDIA's GB203 appendix Table 4. See that row's notes for the full explanation and for why the FP32-accumulate variant is deliberately not recorded. AUDIT 2026-10-03 (NVIDIA dense/sparse convention re-verified from the primary whitepaper PDF, no values changed): NVIDIA's GeForce RTX Blackwell architecture whitepaper (source consumer-nvidia-rtx-blackwell-gpu-architecture-whitepaper, images.nvidia.com/aem-dam/Solutions/geforce/blackwell/) prints every tensor row in the form 'DENSE/SPARSE' and defines the second number in a single footnote that is identical on every appendix page: 'Effective TOPS / TFLOPS using the Sparsity Feature'. Every 'Peak ... Tensor TFLOPS' and 'Peak INT8 Tensor TOPS' row on the sheet therefore carries that marker, while the 'non-Tensor' rows (FP32/FP16/BF16 non-tensor, Peak INT32 TOPS non-Tensor) and the RT TFLOPS row do NOT. Each sparse row was re-checked against that sheet page by page and every dense:false row on this record corresponds to a printed second number, with its dense twin present as a separate dense:true row. Note the sheet's own footnote 1, 'Peak rates are based on GPU Boost Clock' - these are boost-clock peaks, not sustained, and not measured. GB203 appendix, Table 4 'GeForce RTX 5080 vs GeForce RTX 4080 vs GeForce RTX 3080 Specs' (PDF page 49): 'Peak FP4 Tensor TFLOPS with FP32 Accumulate (FP4 AI TOPS) 900.4/1801', 'Peak FP8 Tensor TFLOPS with FP16 Accumulate 450.2/900.42', 'Peak FP8 Tensor TFLOPS with FP32 Accumulate 225.1/450.22', 'Peak FP16 Tensor TFLOPS with FP32 Accumulate 112.6/225.12', 'Peak TF32 Tensor TFLOPS 56.3/112.62', 'Peak INT8 Tensor TOPS 450.2/900.42'. fp8 900.4 and fp4 1801 stored here as dense:false are the sparse column; the dense twins 450.2 and 900.4 are stored separately. The same table also independently prints this card's memory row - 'Frame Buffer Memory Size and Type 16 GB GDDR7', 'Memory Interface 256-bit', 'Memory Clock (Data Rate) 30 Gbps', 'Memory Bandwidth 960 GB/sec' - which is where the 960 GB/s and 30 Gbps/pin in this record come from, and it reconciles exactly (256 x 30 / 8 = 960). Mid-rung Blackwell consumer part, 10752 CUDA cores, 2617 MHz boost, 360 W TGP, PCIe Gen5, 65536 KB L2, 2.62 GHz boost clock on the NVIDIA comparison table.
PRECISION CAVEAT - the single most conflated number on consumer hardware. NVIDIA's product pages advertise 'AI TOPS' (5090: 3352, 5080: 1801, 5070 Ti: 1406). The RTX Blackwell whitepaper labels the identical figure 'Peak FP4 Tensor TFLOPS with FP32 Accumulate (FP4 AI TOPS) 1676/3352', where the second value uses the 2:4 structured-sparsity feature (footnote 2: 'Effective TOPS / TFLOPS using the Sparsity Feature'). So the marketing 'AI TOPS' number is FP4 with 2:4 sparsity, not INT4, not FP16, and not dense. It is not comparable to an FP16/BF16 dense figure, to the INT4-vs-FP16 speedup ratios quoted in quantization literature, or to another vendor's dense INT8 number. Only figures NVIDIA publishes with an explicit dense/sparse split are recorded here; every flops entry's dense flag states which half it is.
Inference: 16 GB at 960 GB/s. Bandwidth is strong for the tier; capacity is what limits it. A 16 GB pool quantised leaves almost no headroom for KV cache at long context, where a 24 GB card fits the same model comfortably. Do not rank this part against the 5090 on the 'AI TOPS' ratio - 1801 vs 3352 are both FP4+sparse, and the dense ratio (900.4 vs 1676) is the same 2x, so the marketing ratio is at least self-consistent, but neither is an FP16 number.
ACCUMULATE-MODE DISAMBIGUATION (why there is only one fp16/fp8 entry each): NVIDIA's whitepapers print separate tensor rows per accumulate mode, and the same numeric value can appear as DENSE in one row and SPARSE in another. E.g. on the 4090 'Peak FP16 Tensor TFLOPS with FP16 Accumulate 330.3/660.6' and 'Peak FP16 Tensor TFLOPS with FP32 Accumulate 165.2/330.4' - so 330.3 is DENSE-with-FP16-accumulate and SPARSE-with-FP32-accumulate. Encoding that as a single dense:false entry would be wrong. The flops array here therefore records ONE entry per precision, always the FP32-accumulate figure, because that is what LLM inference kernels use; the FP16-accumulate variants are stated in this note instead of being mislabeled as sparse. 5080 FP16-accumulate variants: fp16 dense 225.1 / sparse 450.2 TFLOPS; fp8 (fp16 accumulate) dense 450.2 / sparse 900.4 TFLOPS. The recorded fp16 112.6 and fp8 225.1 entries are both FP32-accumulate dense. INTERCONNECT FILLED 2026-10-04: interconnect was empty; it now reads ['pcie-gen5'], from the vendor's own spec table (source the GeForce RTX 5080 product page's 'Technology Support' row). SCALE-UP IS ABSENT AND THAT IS THE POINT: this part has no NVLink and no other GPU-to-GPU fabric, so the host link is the ONLY interconnect a multi-GPU deployment has. Do not infer a fabric from the presence of a PCIe value, and do not read the Gen number as a multi-GPU capability.