AMD MI300X: measured power-limit sweep finds efficiency peak hardware- and workload-specific, and power limits below 400 W are not respected
Fields
benchmarks/mi300x-power-limit-floor-400w-not-respectedNotes
TWO RESULTS WORTH KEEPING, BOTH NON-NVIDIA. (1) POWER-CAP FLOOR: 'amd-smi did not allow power state modifications, and the MI300X did not respect power limits set below 400 W' - so a power-capped MI300X energy measurement below 400 W is not measuring what the cap says it is. This is the AMD-side twin of the MLPerf MaxQ gotcha already in the repo (mlperf-maxq-is-not-a-watt-cap): a vendor power-control surface that looks authoritative and is not. (2) MI300X SHAPE: the MI300X had the LOWEST overall energy efficiency of the three accelerators but the FLATTEST response to rising power limits, and the authors tie that flatness to a power-limit-dependent change in MEMORY CLOCK on the AMD platform - i.e. on AMD the cap is partly enforced by dropping memory clock, not just core clock, so a cap-induced slowdown is not a clean core-clock experiment. By contrast H100 efficiency peaks at 300-400 W depending on workload and H200 at ~400 W with flatter high-power behaviour. NO JOUles/TOKEN FIGURE FOR MI300X IS RECORDED: this paper reports work units per Joule, not tokens per joule, and converting would require assuming a throughput the paper does not tabulate per token.
ENERGY-FIELD BACKFILL 2026-10-05 (schema authority pass, agent w5-schema). energy_basis / power_w / power_scope / power_cap / clock_lock_mhz / thermal_state were all DRAFTED and shipped UNUSED: before this commit zero records in the repo set power_w, power_scope or thermal_state, and the joules figures travelled as prose inside `unit` while metric enum member joules_per_token had zero records. They are populated here from facts this record already documented. WHY power_cap IS 400 RATHER THAN ANY HIGHER VALUE: this record's entire content is that the part would not honour anything below 400 W, so 400 W is the one number here that is both a cap and a measured fact about enforcement. This is the AMD-side twin of gotcha mlperf-maxq-is-not-a-watt-cap: a vendor power-control surface that looks authoritative and is not.