inference/research
verifiedhigh · 0.85updated 2026-10-17

MLPerf Inference v6.1 summary.csv CPU-only Xeon 6 rows

benchmark

Fields

id
sources/mlperf-v6-1-summary-csv-xeon6-cpu
Publisher
MLCommons
Kind
benchmark
Published
2026
Accessed
2026-10-17
notes
Top-level summary.csv of the MLPerf Inference v6.1 results repo, filtered to rows whose accelerator_model_name is N/A (CPU-only). Host processors are Xeon 6 Granite Rapids: 6980P (128c, 2S), 6972P (96c, 2S), 6787P (86c, 2S), 6788P (86c, 2S and 4S). Models filed: llama3.1-8b INT8 Offline and Server (Tokens/s, aggregate) and one whisper INT8 Offline row (Samples/s). Framework column is PyTorch; Dell's note says vLLM with FP8 KV cache. Not a per-request decode number.

Notes

Top-level summary.csv of the MLPerf Inference v6.1 results repo, filtered to rows whose accelerator_model_name is N/A (CPU-only). Host processors are Xeon 6 Granite Rapids: 6980P (128c, 2S), 6972P (96c, 2S), 6787P (86c, 2S), 6788P (86c, 2S and 4S). Models filed: llama3.1-8b INT8 Offline and Server (Tokens/s, aggregate) and one whisper INT8 Offline row (Samples/s). Framework column is PyTorch; Dell's note says vLLM with FP8 KV cache. Not a per-request decode number.

Cross-references

This record references no other records.