The Joule Point: an Energy-Optimal Operating Point for AI Inference (arXiv:2609.27926)

arXiv preprint, cs.PF, 18 pages, CC BY 4.0. Primary measurement study: dense power-cap dataset ELF sweeping 20 inference models across 4 GPUs. Finding that energy per inference is U-shaped in the operating point (GPU, power cap) because board power rises superlinearly along the power-performance curve on top of a fixed power floor; minimum at a cap of 43-46% of rated power, cutting energy per inference by roughly a quarter to a third, with each request about 1.2x slower and holding aggregate throughput costing the same factor more cards. Under load the optimum is nearly a per-card-type constant, so a single static cap captures nearly all the saving (mean penalty under 1%). Fleet simulation under a power budget: 18-45% less energy per served job.