Intel Arc Pro B60 24GB x4, MLPerf v6.0 Server: Llama-2-70B aggregate tok/s
1106.26 output tok/s AGGREGATE across 4x Arc Pro B60 (Server; ~277 tok/s per card)
Fields
id
benchmarks/b60-4x-mlperf-v6-0-llama2-70b-server-tokensMetric
tps_aggregate
Value
1,106.26
Unit
output tok/s AGGREGATE across 4x Arc Pro B60 (Server; ~277 tok/s per card)
Model
Llama-2-70B (FP8)
Methodology
VENDOR-MEASURED (MLPerf v6.0 closed submission, Intel). 4x Arc Pro B60 24GB GDDR6 (PCIe Gen5 x8) on Xeon 698X host, PyTorch vLLM, Llama-2-70B, Server. 'Tokens per second' = 1106.26 verbatim from mlperf_log_summary.txt. AGGREGATE across 4 cards — ~277/card.
Measured by
vendor
Reproducible
yes