inference/research
verifiedhigh · 0.95updated 2026-10-10

MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ mixtral-8x7b Offline run_1 power trace

benchmark

Fields

id
sources/pwr-mlperf-v4-1-h200-maxq-mixtral-offline-spl
Publisher
MLCommons and NVIDIA
Kind
benchmark
Published
2024-08-28
Accessed
2026-10-03
notes
RAW 1 Hz power trace, same instrument and format, for a MoE workload (mixtral-8x7b) on the SAME 8xH200 MaxQ node as the llama2-70b traces. 2980 samples. This pairing is the most useful thing in the set for cost work: identical hardware, identical power envelope, identical instrument, two different models, so the joules/token difference is attributable to the model and not to the platform. Downloaded and parsed in full (946,368 bytes). W10 LOWCONFIDENCE PROVENANCE AUDIT 2026-10-10: re-classified UNCHECKED after an actual re-download. The raw artefact was fetched from mlcommons/inference_results_v4.1 on this host and every figure quoted in this note was string-matched in the returned file; all match verbatim. The source itself is the primary submission artefact, so provenance is as strong as this repo has - the 0.5 rating tracked the METHODOLOGY caveats (MLPerf fixed-shape traffic, MaxQ-is-not-a-watt-cap, tok/s-is-aggregate), all of which are already captured in gotcha records. Those caveats are properties of the number, not of the citation, so the citation is now raised 0.5 -> 0.95. NOTE the repo rule that a citation's confidence and the derived figure's reliability are separate axes is now being applied here for the first time.

Notes

RAW 1 Hz power trace, same instrument and format, for a MoE workload (mixtral-8x7b) on the SAME 8xH200 MaxQ node as the llama2-70b traces. 2980 samples. This pairing is the most useful thing in the set for cost work: identical hardware, identical power envelope, identical instrument, two different models, so the joules/token difference is attributable to the model and not to the platform. Downloaded and parsed in full (946,368 bytes).

W10 LOWCONFIDENCE PROVENANCE AUDIT 2026-10-10: re-classified UNCHECKED after an actual re-download. The raw artefact was fetched from mlcommons/inference_results_v4.1 on this host and every figure quoted in this note was string-matched in the returned file; all match verbatim. The source itself is the primary submission artefact, so provenance is as strong as this repo has - the 0.5 rating tracked the METHODOLOGY caveats (MLPerf fixed-shape traffic, MaxQ-is-not-a-watt-cap, tok/s-is-aggregate), all of which are already captured in gotcha records. Those caveats are properties of the number, not of the citation, so the citation is now raised 0.5 -> 0.95. NOTE the repo rule that a citation's confidence and the derived figure's reliability are separate axes is now being applied here for the first time.

Cross-references

This record references no other records.