inference/research
verifiedmedium · 0.80updated 2026-10-03

Power Aware Dynamic Reallocation For Inference / RAPID (arXiv:2601.12241)

paper

Fields

id
sources/pwr2-arxiv-power-aware-reallocation
Publisher
Yiwei Jiang, Sangeeta Chowdhary, Nathaniel Morris, Rutwik Jain, Srilatha Manne, Sam Bayliss
Kind
paper
Published
2026-01-18
Accessed
2026-10-03
notes
arXiv preprint, cs.DC. Disaggregated prefill/decode inference framework that jointly manages GPU roles and power budgets, framing the constraint directly: 'as model and cluster scales grow, power, rather than compute, has become the dominant limiter of overall performance and cost efficiency.' Claims up to 2x improvement in SLO attainment at peak load versus a static assignment under fixed power caps, with no increase in complexity or cost. Speedup figure is the authors' own and carries no stated baseline cluster size or workload in the abstract, so treat as directional.

Notes

arXiv preprint, cs.DC. Disaggregated prefill/decode inference framework that jointly manages GPU roles and power budgets, framing the constraint directly: 'as model and cluster scales grow, power, rather than compute, has become the dominant limiter of overall performance and cost efficiency.' Claims up to 2x improvement in SLO attainment at peak load versus a static assignment under fixed power caps, with no increase in complexity or cost. Speedup figure is the authors' own and carries no stated baseline cluster size or workload in the abstract, so treat as directional.

Cross-references

This record references no other records.