NVIDIA RTX A6000
nvidia ampere (GA102) 2020
Fields
id
accelerators/nvidia-rtx-a6000Vendor
nvidia
Architecture
ampere (GA102)
Release year
2020
Form factors
pcie
VRAM (GB)
48
Memory type
gddr6 with ECC
Memory bus (bit)
384
Memory bandwidth (GB/s)
768
Bandwidth basis
vendor spec table value as printed in cited source
TDP (W)
300
Unified memory
no
Consumer part
no
notes
Workstation Ampere card, 48 GB GDDR6 ECC, 768 GB/s. LLM-relevant because 48 GB per card at used-market prices; measured LLaMA-3 numbers in repo benchmarks come from the XiongjieDai RunPod table and the Hardware Corner ranking.
Notes
Workstation Ampere card, 48 GB GDDR6 ECC, 768 GB/s. LLM-relevant because 48 GB per card at used-market prices; measured LLaMA-3 numbers in repo benchmarks come from the XiongjieDai RunPod table and the Hardware Corner ranking.