inference/research
verifiedhigh · 0.95updated 2026-10-10

MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ mixtral-8x7b Offline LoadGen summary

benchmark

Fields

id
sources/pwr-mlperf-v4-1-h200-maxq-mixtral-offline-summary
Publisher
MLCommons and NVIDIA
Kind
benchmark
Published
2024-08-28
Accessed
2026-10-03
notes
AUDITED MLPerf LoadGen result for the paired mixtral-8x7b Offline power trace. Key fields verbatim: 'Samples per second: 335.674', 'Tokens per second: 48987.9', 'Result is : VALID', min_duration 2400000 ms. This is the throughput denominator for the MoE joules/token figure. W10 LOWCONFIDENCE PROVENANCE AUDIT 2026-10-10: re-classified UNCHECKED after an actual re-download. The raw artefact was fetched from mlcommons/inference_results_v4.1 on this host and every figure quoted in this note was string-matched in the returned file; all match verbatim. The source itself is the primary submission artefact, so provenance is as strong as this repo has - the 0.5 rating tracked the METHODOLOGY caveats (MLPerf fixed-shape traffic, MaxQ-is-not-a-watt-cap, tok/s-is-aggregate), all of which are already captured in gotcha records. Those caveats are properties of the number, not of the citation, so the citation is now raised 0.5 -> 0.95. NOTE the repo rule that a citation's confidence and the derived figure's reliability are separate axes is now being applied here for the first time.

Notes

AUDITED MLPerf LoadGen result for the paired mixtral-8x7b Offline power trace. Key fields verbatim: 'Samples per second: 335.674', 'Tokens per second: 48987.9', 'Result is : VALID', min_duration 2400000 ms. This is the throughput denominator for the MoE joules/token figure.

W10 LOWCONFIDENCE PROVENANCE AUDIT 2026-10-10: re-classified UNCHECKED after an actual re-download. The raw artefact was fetched from mlcommons/inference_results_v4.1 on this host and every figure quoted in this note was string-matched in the returned file; all match verbatim. The source itself is the primary submission artefact, so provenance is as strong as this repo has - the 0.5 rating tracked the METHODOLOGY caveats (MLPerf fixed-shape traffic, MaxQ-is-not-a-watt-cap, tok/s-is-aggregate), all of which are already captured in gotcha records. Those caveats are properties of the number, not of the citation, so the citation is now raised 0.5 -> 0.95. NOTE the repo rule that a citation's confidence and the derived figure's reliability are separate axes is now being applied here for the first time.

Cross-references

This record references no other records.