AI Application Benchmarking: Power-Aware Performance Analysis for Vision and Language Models (arXiv:2603.16164, RRZE-HPC)

arXiv preprint, cs.PF, v2 dated 2026-03-17, from Erlangen NHR (RRZE-HPC). Measured H100, H200 and AMD MI300X under varying power limits. Energy efficiency defined as throughput / (P_GPU + 100 W / N_GPU) with an explicit constant 100 W per node system overhead added. Key non-NVIDIA result: the MI300X showed the LOWEST overall energy efficiency of the three but the FLATTEST response to rising power limits, coinciding with a power-limit-dependent memory clock change on the AMD platform. Practical finding for anyone power-capping AMD: 'amd-smi did not allow power state modifications, and the MI300X did not respect power limits set below 400 W'. Code at github.com/RRZE-HPC/hpc-ai-perf-bench, Zenodo 20083679.