inference/research
draftlow · 0.50updated 2026-10-05

NVIDIA H20

nvidia hopper 2024
This record is a draft. Not yet verified. Provisional. Treat every number on this page as provisional.

Fields

id
accelerators/nvidia-h20
Vendor
nvidia
Architecture
hopper
Release year
2024
Process (nm)
4
Form factors
sxm
VRAM (GB)
96
Memory type
HBM3
Memory bus (bit)
6,144
Memory bandwidth (GB/s)
4,000
Bandwidth basis
96GB HBM3 at 4.0 TB/s as reported by the secondary aggregator. 96GB = 8 x 12GB stacks; the 6144-bit bus width is INFERRED from 96GB and is not printed by any source I could reach. Treat the bus width as low-confidence.
Peak FLOPS
precisionfp32tflops44denseyesvendor_claimnosource_idnv-h20-flopper-specsheetbasissecondary-aggregatorbasis_detailflopper.io, a third-party aggregator (kind: 'database', the weakest kind in the source schema). NVIDIA's absence of a specification for this part is now a VERIFIED NEGATIVE rather than an assumption: five site-restricted searches on nvidia.com, resources.nvidia.com and developer.nvidia.com returned zero first-party results; https://www.nvidia.com/en-us/data-center/h20/ resolves to no specification document; resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text; nvidianews.com carries only the press release. The one document titled 'Nvidia H20 GPU Datasheet' that exists is a user upload on Scribd, not an NVIDIA publication, and is not treated as one. vendor_claim is FALSE on every row for this reason and status stays 'draft'. DO NOT fill these rows from the H100 datasheet by scaling: H20 is a cut Hopper and the cut is not a published ratio. The FP8/INT8 296 figure is the source's sparse number, so dense would be 148 - see the notes. See w5a-nvidia-h20-no-nvidia-document-exists-verified-negative.precisiontf32tflops74denseyesvendor_claimnosource_idnv-h20-flopper-specsheetbasissecondary-aggregatorbasis_detailflopper.io, a third-party aggregator (kind: 'database', the weakest kind in the source schema). NVIDIA's absence of a specification for this part is now a VERIFIED NEGATIVE rather than an assumption: five site-restricted searches on nvidia.com, resources.nvidia.com and developer.nvidia.com returned zero first-party results; https://www.nvidia.com/en-us/data-center/h20/ resolves to no specification document; resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text; nvidianews.com carries only the press release. The one document titled 'Nvidia H20 GPU Datasheet' that exists is a user upload on Scribd, not an NVIDIA publication, and is not treated as one. vendor_claim is FALSE on every row for this reason and status stays 'draft'. DO NOT fill these rows from the H100 datasheet by scaling: H20 is a cut Hopper and the cut is not a published ratio. The FP8/INT8 296 figure is the source's sparse number, so dense would be 148 - see the notes. See w5a-nvidia-h20-no-nvidia-document-exists-verified-negative.precisionbf16tflops148denseyesvendor_claimnosource_idnv-h20-flopper-specsheetbasissecondary-aggregatorbasis_detailflopper.io, a third-party aggregator (kind: 'database', the weakest kind in the source schema). NVIDIA's absence of a specification for this part is now a VERIFIED NEGATIVE rather than an assumption: five site-restricted searches on nvidia.com, resources.nvidia.com and developer.nvidia.com returned zero first-party results; https://www.nvidia.com/en-us/data-center/h20/ resolves to no specification document; resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text; nvidianews.com carries only the press release. The one document titled 'Nvidia H20 GPU Datasheet' that exists is a user upload on Scribd, not an NVIDIA publication, and is not treated as one. vendor_claim is FALSE on every row for this reason and status stays 'draft'. DO NOT fill these rows from the H100 datasheet by scaling: H20 is a cut Hopper and the cut is not a published ratio. The FP8/INT8 296 figure is the source's sparse number, so dense would be 148 - see the notes. See w5a-nvidia-h20-no-nvidia-document-exists-verified-negative.precisionfp16tflops148denseyesvendor_claimnosource_idnv-h20-flopper-specsheetbasissecondary-aggregatorbasis_detailflopper.io, a third-party aggregator (kind: 'database', the weakest kind in the source schema). NVIDIA's absence of a specification for this part is now a VERIFIED NEGATIVE rather than an assumption: five site-restricted searches on nvidia.com, resources.nvidia.com and developer.nvidia.com returned zero first-party results; https://www.nvidia.com/en-us/data-center/h20/ resolves to no specification document; resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text; nvidianews.com carries only the press release. The one document titled 'Nvidia H20 GPU Datasheet' that exists is a user upload on Scribd, not an NVIDIA publication, and is not treated as one. vendor_claim is FALSE on every row for this reason and status stays 'draft'. DO NOT fill these rows from the H100 datasheet by scaling: H20 is a cut Hopper and the cut is not a published ratio. The FP8/INT8 296 figure is the source's sparse number, so dense would be 148 - see the notes. See w5a-nvidia-h20-no-nvidia-document-exists-verified-negative.precisionfp8tflops296densenovendor_claimnosource_idnv-h20-flopper-specsheetbasissecondary-aggregatorbasis_detailflopper.io, a third-party aggregator (kind: 'database', the weakest kind in the source schema). NVIDIA's absence of a specification for this part is now a VERIFIED NEGATIVE rather than an assumption: five site-restricted searches on nvidia.com, resources.nvidia.com and developer.nvidia.com returned zero first-party results; https://www.nvidia.com/en-us/data-center/h20/ resolves to no specification document; resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text; nvidianews.com carries only the press release. The one document titled 'Nvidia H20 GPU Datasheet' that exists is a user upload on Scribd, not an NVIDIA publication, and is not treated as one. vendor_claim is FALSE on every row for this reason and status stays 'draft'. DO NOT fill these rows from the H100 datasheet by scaling: H20 is a cut Hopper and the cut is not a published ratio. The FP8/INT8 296 figure is the source's sparse number, so dense would be 148 - see the notes. See w5a-nvidia-h20-no-nvidia-document-exists-verified-negative.precisionint8tflops296densenovendor_claimnosource_idnv-h20-flopper-specsheetbasissecondary-aggregatorbasis_detailflopper.io, a third-party aggregator (kind: 'database', the weakest kind in the source schema). NVIDIA's absence of a specification for this part is now a VERIFIED NEGATIVE rather than an assumption: five site-restricted searches on nvidia.com, resources.nvidia.com and developer.nvidia.com returned zero first-party results; https://www.nvidia.com/en-us/data-center/h20/ resolves to no specification document; resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text; nvidianews.com carries only the press release. The one document titled 'Nvidia H20 GPU Datasheet' that exists is a user upload on Scribd, not an NVIDIA publication, and is not treated as one. vendor_claim is FALSE on every row for this reason and status stays 'draft'. DO NOT fill these rows from the H100 datasheet by scaling: H20 is a cut Hopper and the cut is not a published ratio. The FP8/INT8 296 figure is the source's sparse number, so dense would be 148 - see the notes. See w5a-nvidia-h20-no-nvidia-document-exists-verified-negative.
TDP (W)
400
Unified memory
no
Consumer part
no
notes
VERIFIED NEGATIVE, 2026-10-05: the claim 'NVIDIA has never published an H20 datasheet', which this record has asserted since it was written and which every downstream reader would have taken on trust, has now actually been tested. IT STANDS, and it now stands on evidence rather than on absence of effort. Five independent searches were run, all site-restricted to NVIDIA's own domains - 'NVIDIA H20 datasheet site:nvidia.com', 'site:resources.nvidia.com H20', 'NVIDIA H20 site:developer.nvidia.com', '"HGX H20" datasheet nvidia pdf', and a developer-blog query. Every one returned ZERO nvidia.com results. Direct probes of the canonical first-party URLs confirm it: nvidia.com/en-us/data-center/h20/ resolves to no specification document, resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text, and nvidianews.com carries only the press release. The only hits anywhere were aggregators and news (flopper.io, inferencebench.io, qscompute.com, baike.baidu.com) plus one Scribd upload titled 'Nvidia H20 GPU Datasheet' - a user upload on a document-sharing site, not an NVIDIA publication, recorded so a future pass does not mistake it for the missing document. The shape of the absence is itself consistent with the explanation: H20 is the export-restricted Hopper part whose compute was cut to satisfy US export controls while its memory subsystem was left generous, so the compute table is exactly the thing a vendor would omit. WHAT THE NEGATIVE DOES NOT DO: it does not make the six figures right. They still come from flopper.io, typed kind 'database', which is why vendor_claim is false on all six rows and status stays 'draft'. This is the lowest-confidence set in data/ deliberately, and the honest statement is 'NVIDIA does not publish these', not 'these are NVIDIA's figures'. BUS WIDTH IS STILL INFERRED, not sourced: 6144-bit follows from 96GB across eight 12GB HBM3 stacks and no document prints it. Treat as low-confidence - it is the weakest field on this record. WHY THE PART MATTERS, restated because it is the reason to keep a draft record at all: 148 dense FP16 TFLOPS against 96 GB at 4.0 TB/s is roughly two-thirds of H100 SXM's dense 989 TFLOPS but a HIGHER bandwidth-per-FLOP ratio than H100's. That is a memory-rich, compute-poor Hopper - the opposite trade from H100 - and for inference, where decode is bandwidth-bound, it is the more interesting half of the part. The FP8/INT8 296 figure is sparse per the source, so dense would be 148.

Notes

VERIFIED NEGATIVE, 2026-10-05: the claim 'NVIDIA has never published an H20 datasheet', which this record has asserted since it was written and which every downstream reader would have taken on trust, has now actually been tested. IT STANDS, and it now stands on evidence rather than on absence of effort. Five independent searches were run, all site-restricted to NVIDIA's own domains - 'NVIDIA H20 datasheet site:nvidia.com', 'site:resources.nvidia.com H20', 'NVIDIA H20 site:developer.nvidia.com', '"HGX H20" datasheet nvidia pdf', and a developer-blog query. Every one returned ZERO nvidia.com results. Direct probes of the canonical first-party URLs confirm it: nvidia.com/en-us/data-center/h20/ resolves to no specification document, resources.nvidia.com's HGX H20 entry is a JS PDF viewer with no extractable text, and nvidianews.com carries only the press release. The only hits anywhere were aggregators and news (flopper.io, inferencebench.io, qscompute.com, baike.baidu.com) plus one Scribd upload titled 'Nvidia H20 GPU Datasheet' - a user upload on a document-sharing site, not an NVIDIA publication, recorded so a future pass does not mistake it for the missing document. The shape of the absence is itself consistent with the explanation: H20 is the export-restricted Hopper part whose compute was cut to satisfy US export controls while its memory subsystem was left generous, so the compute table is exactly the thing a vendor would omit. WHAT THE NEGATIVE DOES NOT DO: it does not make the six figures right. They still come from flopper.io, typed kind 'database', which is why vendor_claim is false on all six rows and status stays 'draft'. This is the lowest-confidence set in data/ deliberately, and the honest statement is 'NVIDIA does not publish these', not 'these are NVIDIA's figures'. BUS WIDTH IS STILL INFERRED, not sourced: 6144-bit follows from 96GB across eight 12GB HBM3 stacks and no document prints it. Treat as low-confidence - it is the weakest field on this record. WHY THE PART MATTERS, restated because it is the reason to keep a draft record at all: 148 dense FP16 TFLOPS against 96 GB at 4.0 TB/s is roughly two-thirds of H100 SXM's dense 989 TFLOPS but a HIGHER bandwidth-per-FLOP ratio than H100's. That is a memory-rich, compute-poor Hopper - the opposite trade from H100 - and for inference, where decode is bandwidth-bound, it is the more interesting half of the part. The FP8/INT8 296 figure is sparse per the source, so dense would be 148.

Cross-references