Request-Level Energy Attribution for Batched LLM Serving / JouleShare (arXiv:2608.00026)
paper
Fields
id
sources/pwr2-arxiv-joulesharePublisher
Qi Luo, Kunlin Li, Ziwen Wang, Dongsheng Wang, Yun Chen
Kind
paper
Published
2026-07-11
Accessed
2026-10-03
notes
arXiv preprint, cs.AI, 12 pages. Establishes measured request-level energy ground truth by replaying request subsets under vLLM with GPU power telemetry and computing exact Shapley energy per request. Across 16 model/workload runs on three datacentre GPUs, token-proportional attribution differs from exact Shapley by 0.440 normalized L1 under static batching and 0.458 under continuous batching - i.e. the naive 'cost per token' chargeback rule is measurably wrong for batched serving. A calibration model reduces the error to 0.116 / 0.177.
Notes
arXiv preprint, cs.AI, 12 pages. Establishes measured request-level energy ground truth by replaying request subsets under vLLM with GPU power telemetry and computing exact Shapley energy per request. Across 16 model/workload runs on three datacentre GPUs, token-proportional attribution differs from exact Shapley by 0.440 normalized L1 under static batching and 0.458 under continuous batching - i.e. the naive 'cost per token' chargeback rule is measurably wrong for batched serving. A calibration model reduces the error to 0.116 / 0.177.
Cross-references
This record references no other records.