Amazon EC2 Trn2 Architecture · inference-research

Fields

id

sources/alt-trn2-arch

URL

https://awsdocs-neuron.readthedocs-hosted.com/en/latest/about-neuron/arch/neuron-hardware/trn2-arch.html

Publisher

Amazon Web Services

Kind

spec-sheet

Published

2026-08-17

Accessed

2026-10-04

notes

16 Trainium2 chips, NeuronLink-v3 1024 GB/s/chip intra-instance, 256 GB/s inter-instance (UltraServer). 20.8 FP8 PFLOPS, 10.7 FP16/BF16 PFLOPS per 16-chip instance. 1.5 TB HBM3, 46.4 TB/s. 2D torus within instance, 3D torus UltraServer.

Notes

16 Trainium2 chips, NeuronLink-v3 1024 GB/s/chip intra-instance, 256 GB/s inter-instance (UltraServer). 20.8 FP8 PFLOPS, 10.7 FP16/BF16 PFLOPS per 16-chip instance. 1.5 TB HBM3, 46.4 TB/s. 2D torus within instance, 3D torus UltraServer.

Cross-references

This record references no other records.