inference/research
verifiedhigh · 0.95updated 2026-10-04

Intel Gaudi 3 AI Accelerator Technical Paper section 4 Host Interface - PCIe Gen5 bandwidth prose (VERBATIM)

whitepaper

Fields

id
sources/vb-intel-gaudi3-paper-host-interface-prose
Publisher
Intel
Kind
whitepaper
Accessed
2026-10-04
notes
VERBATIM, section 4: 'This advanced interface offers an impressive total bandwidth of 128 GB/sec, with 64 GB/sec available in each direction. This is a substantial improvement over the 64 GB/sec total bandwidth (32 GB/sec in each direction) provided by the Gen 4 PCIe.' THIS IS THE DEFINITIVE CONVENTION STATEMENT IN PROSE, independent of Table 1: Gen5 x16 = 128 GB/sec TOTAL, 64 GB/sec PER DIRECTION; Gen4 x16 = 64 GB/sec TOTAL, 32 GB/sec PER DIRECTION. A third place in the same paper labels the aggregate 'bidirectional' (Table 8). The Gaudi 3 record's stored 128 GB/s is therefore the correct AGGREGATE and must not be halved; the Gaudi 2 record's 64 GB/s is the correct AGGREGATE for Gen4. Neither record stores a per-direction figure. PCIe Gen5 x16 raw is 63 GB/s per direction after 128b/130b encoding, so Intel's 64 GB/s per direction is the rounded raw-link figure and its 128 GB/s is exactly 2x.

Notes

VERBATIM, section 4: 'This advanced interface offers an impressive total bandwidth of 128 GB/sec, with 64 GB/sec available in each direction. This is a substantial improvement over the 64 GB/sec total bandwidth (32 GB/sec in each direction) provided by the Gen 4 PCIe.' THIS IS THE DEFINITIVE CONVENTION STATEMENT IN PROSE, independent of Table 1: Gen5 x16 = 128 GB/sec TOTAL, 64 GB/sec PER DIRECTION; Gen4 x16 = 64 GB/sec TOTAL, 32 GB/sec PER DIRECTION. A third place in the same paper labels the aggregate 'bidirectional' (Table 8). The Gaudi 3 record's stored 128 GB/s is therefore the correct AGGREGATE and must not be halved; the Gaudi 2 record's 64 GB/s is the correct AGGREGATE for Gen4. Neither record stores a per-direction figure. PCIe Gen5 x16 raw is 63 GB/s per direction after 128b/130b encoding, so Intel's 64 GB/s per direction is the rounded raw-link figure and its 128 GB/s is exactly 2x.

Cross-references

This record references no other records.