Intel Xeon 6980P (Granite Rapids-AP, 128-core, 12-channel DDR5 host CPU)

Fields

id

accelerators/intel-xeon-6980p-granite-rapids

Vendor

intel

Architecture

Redwood Cove (Granite Rapids-AP, Xeon 6, LGA 7529)

Release year

2024

Process (nm)

3

Form factors

Memory type

DDR5-6400 RDIMM, 12 channels (MRDIMM-8800 supported)

Memory bandwidth (GB/s)

614.4

Bandwidth basis

DERIVED, not a printed Intel bandwidth. ARK lists 12 memory channels and DDR5-6400. 12 channels x 8 bytes x 6.4 GT/s = 614.4 GB/s theoretical peak per socket at 1 DPC. MRDIMM-8800 would be 12 x 8 x 8.8 = 844.8 GB/s and is NOT the figure stored, because the MLPerf rows do not state which DIMM was fitted. Dell's 6980P whisper system is listed at 6400 MT/s.

TDP (W)

500

Unified memory

yes

Consumer part

no

notes

CPU-only inference host, same shape as amd-epyc-9554-genoa: the memory that matters is the socket's DDR5 channel bandwidth, not VRAM. vram_gb null because capacity is how many RDIMMs are fitted (ARK max 3 TB). 128 P-cores, AMX present. MLPerf Inference v6.1 closed CPU-only rows (accelerator_model_name N/A) on 2S 6980P: Intel's own 2S box does 1916.74 tok/s Offline / 1139.51 tok/s Server on llama3.1-8b INT8, aggregate across both sockets. Not a consumer part (RCP $13,955) but it is the CPU path the plan asked for, and it is the first Xeon in this repo.

Notes

CPU-only inference host, same shape as amd-epyc-9554-genoa: the memory that matters is the socket's DDR5 channel bandwidth, not VRAM. vram_gb null because capacity is how many RDIMMs are fitted (ARK max 3 TB). 128 P-cores, AMX present. MLPerf Inference v6.1 closed CPU-only rows (accelerator_model_name N/A) on 2S 6980P: Intel's own 2S box does 1916.74 tok/s Offline / 1139.51 tok/s Server on llama3.1-8b INT8, aggregate across both sockets. Not a consumer part (RCP $13,955) but it is the CPU path the plan asked for, and it is the first Xeon in this repo.

Cross-references

This record references no other records — it is a leaf. It is cited by 5.