Characterizing Performance-Energy Trade-offs of Large Language Models in Multi-Request Workflows (arXiv:2604.09611)
Fields
sources/pwr2-arxiv-multi-request-energyNotes
arXiv preprint, cs.DC. A100 testbed with vLLM and Parrot across four workflow patterns (sequential, interactive, agentic, composite). Findings: batch size is the most impactful energy lever but workload-dependent - optimal batching helps large-shared-prompt workloads, is ineffective for sequential summarization, partially effective for multi-agent coding; GPU power capping gives modest but predictable savings; output length induces linear energy scaling with limited efficiency gains; vLLM's engine-level optimizations maintain higher GPU utilization especially for decode-heavy workloads, while Parrot's workflow-aware scheduling achieves lower energy under strict power constraints. Argues for both engines to be run before quoting a power-efficiency number.
Cross-references
This record references no other records.