inference/research
verifiedlow · 0.50updated 2026-10-17

MLPerf Inference v5.0 — Cisco UCS X215 M8 2x L40S gptj-99 submission (raw logs)

benchmark

Fields

id
sources/bench-mlperf-v5-0-cisco-x215m8-2xl40s-gptj99
Publisher
MLCommons / Cisco
Kind
benchmark
Accessed
2026-10-17
notes
MLPerf Inference v5.0 closed submission, Cisco UCS X215 M8 (system id X215M8-L40Sx2_TRT), 2x NVIDIA L40S, TensorRT 10.8 / CUDA 12.8, host 2x AMD EPYC 9224. gptj-99 only — there is no gptj-99.9 directory for this system. Weights fp8 per measurements/X215M8-L40Sx2_TRT/gptj-99/Offline/X215M8-L40Sx2_TRT_Offline.json (weight_transformations: quantization, affine fusion). Numbers quoted from performance/run_1/mlperf_log_summary.txt: Offline "Tokens per second (inferred): 1754.97" VALID; Server "Completed tokens per second (inferred): 1745.78" VALID. The system JSON states accelerator_memory_capacity "64 GB" for two cards, which is inconsistent with the L40S 48GB spec; the summary row names the same system and counts 2 accelerators.

Notes

MLPerf Inference v5.0 closed submission, Cisco UCS X215 M8 (system id X215M8-L40Sx2_TRT), 2x NVIDIA L40S, TensorRT 10.8 / CUDA 12.8, host 2x AMD EPYC 9224. gptj-99 only — there is no gptj-99.9 directory for this system. Weights fp8 per measurements/X215M8-L40Sx2_TRT/gptj-99/Offline/X215M8-L40Sx2_TRT_Offline.json (weight_transformations: quantization, affine fusion). Numbers quoted from performance/run_1/mlperf_log_summary.txt: Offline "Tokens per second (inferred): 1754.97" VALID; Server "Completed tokens per second (inferred): 1745.78" VALID. The system JSON states accelerator_memory_capacity "64 GB" for two cards, which is inconsistent with the L40S 48GB spec; the summary row names the same system and counts 2 accelerators.

Cross-references

This record references no other records.