PowerInfer: Fast Large Language Model Inference with a Consumer-grade GPU (arXiv 2312.12456)

export.arxiv.org API id_list=2312.12456 returns title 'PowerInfer: Fast Large Language Model Inference with a Consumer-grade GPU', published 2023-12-16, arxiv:comment 'SOSP 2024'. Semantic Scholar venue 'Symposium on Operating Systems Principles', year 2023 (S2's year field is the arXiv posting year, not the venue year - the arXiv comment and the SOSP proceedings both put the paper at SOSP 2024). OpenAlex institutions: Shanghai Jiao Tong University. SOSP proceedings page not independently fetched (ACM DL 403s automated clients).