inference/research
verifiedmedium · 0.80updated 2026-10-17

MLPerf v6.1 Dell R770 2x Xeon 6787P: llama3.1-8b INT8 Offline aggregate tok/s

1227.99 tok/s AGGREGATE over 2x Xeon 6787P (86c, 8-channel)

Fields

id
benchmarks/mlperf-v6-1-dell-2x6787p-llama31-8b-int8-offline
Metric
tps_aggregate
Value
1,227.99
Unit
tok/s AGGREGATE over 2x Xeon 6787P (86c, 8-channel)
Model
llama3.1-8b
Methodology
MLPerf Inference v6.1 closed division, CPU-only (summary.csv accelerator_model_name is N/A). Values copied from summary.csv, not from a per-system mlperf_log_summary.txt. AGGREGATE throughput for the whole node, NOT per-request decode and NOT per-socket. Prompt length, output length, and batch size are not in the summary row. weight_data_types INT8. Framework column is PyTorch; the Dell notes field additionally names vLLM with an FP8 KV cache. Scenario: Offline. System: Dell PowerEdge R770, 2x Xeon 6787P, 16x64GB DDR5-6400. Best-documented CPU row in the file: summary.csv notes say 'Dell PowerEdge R770. vLLM, FP8 KV Cache'. 16 DIMMs on an 8-channel part is 1 DPC, fully populated. 8 channels, not 12 — do not read this as a 6980P number. INT8 weights, FP8 KV. measured_by vendor: these are submitter results inside the MLCommons closed division (Intel, Dell, Supermicro, Quanta, Red Hat, Cisco), not an independent re-run.
Measured by
vendor
Reproducible
yes
notes
Best-documented CPU row in the file: summary.csv notes say 'Dell PowerEdge R770. vLLM, FP8 KV Cache'. 16 DIMMs on an 8-channel part is 1 DPC, fully populated. 8 channels, not 12 — do not read this as a 6980P number. INT8 weights, FP8 KV.

Notes

Best-documented CPU row in the file: summary.csv notes say 'Dell PowerEdge R770. vLLM, FP8 KV Cache'. 16 DIMMs on an 8-channel part is 1 DPC, fully populated. 8 channels, not 12 — do not read this as a 6980P number. INT8 weights, FP8 KV.

Cross-references