NVIDIA RTX A2000 12GB
nvidia ampere (GA106) 2021
Fields
id
accelerators/nvidia-rtx-a2000Vendor
nvidia
Architecture
ampere (GA106)
Release year
2021
Form factors
pcie
VRAM (GB)
12
Memory type
gddr6
TDP (W)
70
Unified memory
no
Consumer part
yes
notes
NVIDIA sells two SKUs under this name: 6 GB and 12 GB, both GDDR6 with ECC, both 70 W, low-profile dual-slot, PCIe Gen4 x16. Bus width and bandwidth are not on the product page, so they are null. The llama.cpp Vulkan row is labelled only 'Nvidia RTX A2000' and does not say which SKU; this record is the 12 GB card because a 7B Q4 plus KV needs the larger one to be comfortable, and the 6 GB SKU would be swapping. Treat the benchmark as SKU-ambiguous.
Notes
NVIDIA sells two SKUs under this name: 6 GB and 12 GB, both GDDR6 with ECC, both 70 W, low-profile dual-slot, PCIe Gen4 x16. Bus width and bandwidth are not on the product page, so they are null. The llama.cpp Vulkan row is labelled only 'Nvidia RTX A2000' and does not say which SKU; this record is the 12 GB card because a 7B Q4 plus KV needs the larger one to be comfortable, and the 6 GB SKU would be swapping. Treat the benchmark as SKU-ambiguous.