inference/research
draftlow · 0.60updated 2026-10-15

NVIDIA A40

nvidia ampere (GA102) 2020
This record is a draft. Not yet verified. Provisional. Treat every number on this page as provisional.

Fields

id
accelerators/nvidia-a40
Vendor
nvidia
Architecture
ampere (GA102)
Release year
2020
Form factors
pcie
VRAM (GB)
48
Memory type
gddr6
Memory bus (bit)
384
Memory bandwidth (GB/s)
696
Bandwidth basis
vendor spec table value as printed in cited source
TDP (W)
300
Unified memory
no
Consumer part
no
notes
Passive-cooled datacenter Ampere card, 48 GB GDDR6, 696 GB/s. Showed up cheap on the used market; llama.cpp measured rows from the XiongjieDai RunPod table.

Notes

Passive-cooled datacenter Ampere card, 48 GB GDDR6, 696 GB/s. Showed up cheap on the used market; llama.cpp measured rows from the XiongjieDai RunPod table.

Cross-references

Interconnect (1)