id
accelerators/nvidia-a100-80gb-sxm4
Memory bandwidth (GB/s)
2,039
Bandwidth basis
HBM2e 2.039 TB/s as published (nv-a100-datasheet). Bus width 5120-bit is the standard GA100 HBM2e interface; the datasheet does not print the bus width, only the aggregate 2039 GB/s.
Peak FLOPS
precisionfp64tflops9.7denseyesvendor_claimyessource_idnv-a100-datasheetnotes—basisvendor-spec-sheetbasis_detailA100 80GB SXM datasheet, FP64 row printed as '9.7 TFLOPS' with the non-tensor column; the 19.5 row is the FP64 Tensor Core path.unitfp64-vectorprecisionfp64tflops19.5denseyesvendor_claimyessource_idnv-a100-datasheetnotes—basisvendor-spec-sheetbasis_detailA100 80GB SXM datasheet, 'FP64 Tensor Core 19.5 TFLOPS'. Separate path from the 9.7 vector figure.unitfp64-tensor-coreprecisionfp32tflops19.5denseyesvendor_claimyessource_idnv-a100-datasheetbasisvendor-spec-sheetbasis_detailA100 80GB SXM datasheet, 'FP64 Tensor Core 19.5 TFLOPS'. Separate path from the 9.7 vector figure.precisiontf32tflops156denseyesvendor_claimyessource_idnv-a100-datasheetbasisvendor-spec-sheetbasis_detailTranscribed from the vendor's own tf32 for NVIDIA A100 80GB SXM4 (source of record: 'NVIDIA A100 Tensor Core GPU datasheet', kind: spec-sheet). Recorded dense:true as printed.precisionbf16tflops312denseyesvendor_claimyessource_idnv-a100-datasheetbasisvendor-spec-sheetbasis_detailTranscribed from the vendor's own bf16 for NVIDIA A100 80GB SXM4 (source of record: 'NVIDIA A100 Tensor Core GPU datasheet', kind: spec-sheet). Recorded dense:true as printed.precisionfp16tflops312denseyesvendor_claimyessource_idnv-a100-datasheetbasisvendor-spec-sheetbasis_detailTranscribed from the vendor's own fp16 for NVIDIA A100 80GB SXM4 (source of record: 'NVIDIA A100 Tensor Core GPU datasheet', kind: spec-sheet). Recorded dense:true as printed.precisionint8tflops624denseyesvendor_claimyessource_idnv-a100-datasheetbasisvendor-spec-sheetbasis_detailTranscribed from the vendor's own int8 for NVIDIA A100 80GB SXM4 (source of record: 'NVIDIA A100 Tensor Core GPU datasheet', kind: spec-sheet). Recorded dense:true as printed.
notes
AUDIT CORRECTION: the dense/sparse flag on the tensor rows was inverted. FP16 312 / INT8 624 TFLOPS are DENSE. NVIDIA A100 page prints '312 | 624*' where * = With sparsity. These rows were previously flagged dense:false, which wrongly told a reader they were sparse. The stored numbers are correct dense values. CRITICAL: every Tensor Core figure on the A100 datasheet is the WITH-SPARITY number (marked '*' on the sheet). Dense is exactly half: TF32 156 dense, BF16/FP16 312 dense, INT8 624 TOPS dense. FP64 9.7 and FP32 19.5 are dense and unaffected by sparsity. The two FP64 entries are the distinct CUDA-core FP64 path (9.7) and the FP64 Tensor Core path (19.5) - Ampere roughly doubles FP64 via Tensor Cores; keep them as separate rows rather than picking one. TDP 400W is the standard config; the sheet notes the HGX A100-80GB CTS SKU can be configured up to 500W. 40GB SXM4 is a separate cut with 1,555 GB/s and 250W. NOTE ON PRECISION LABELS: this schema's precision enum has no 'fp64' member, so the two 'other' rows are FP64 - 9.7 TFLOPS (the GA100 CUDA-core FP64 path) and 19.5 TFLOPS (the FP64 Tensor Core path). They are NOT duplicates: Ampere's FP64 Tensor Core roughly doubles FP64 throughput, and they are recorded separately so a reader does not have to guess which number is which.