Power Aware Dynamic Reallocation For Inference / RAPID (arXiv:2601.12241)
paper
Fields
id
sources/pwr2-arxiv-power-aware-reallocationPublisher
Yiwei Jiang, Sangeeta Chowdhary, Nathaniel Morris, Rutwik Jain, Srilatha Manne, Sam Bayliss
Kind
paper
Published
2026-01-18
Accessed
2026-10-03
notes
arXiv preprint, cs.DC. Disaggregated prefill/decode inference framework that jointly manages GPU roles and power budgets, framing the constraint directly: 'as model and cluster scales grow, power, rather than compute, has become the dominant limiter of overall performance and cost efficiency.' Claims up to 2x improvement in SLO attainment at peak load versus a static assignment under fixed power caps, with no increase in complexity or cost. Speedup figure is the authors' own and carries no stated baseline cluster size or workload in the abstract, so treat as directional.
Notes
arXiv preprint, cs.DC. Disaggregated prefill/decode inference framework that jointly manages GPU roles and power budgets, framing the constraint directly: 'as model and cluster scales grow, power, rather than compute, has become the dominant limiter of overall performance and cost efficiency.' Claims up to 2x improvement in SLO attainment at peak load versus a static assignment under fixed power caps, with no increase in complexity or cost. Speedup figure is the authors' own and carries no stated baseline cluster size or workload in the abstract, so treat as directional.
Cross-references
This record references no other records.