PackServe: SLO-Aware Request Scheduling for Agentic LLM Serving at Scale (arXiv 2609.33224)
paper
Fields
id
sources/pap-sys-packserve-arxivPublisher
arXiv (Microsoft Research Asia / Peking University)
Kind
paper
Published
2026-09-27
Accessed
2026-10-03
notes
arXiv comment '13 pages, 13 figures', cats cs.DC, no venue claim. Abstract is the source of the H20/64-GPU numbers and states the paper reports deployment in the authors' own production environment. Author list from the arXiv API: Zhiyuan Tan, Dejiang Zhu, Jingzhe Jiang, Yihao Zheng, Yang Tian, Tao Wang, Minchen Yu.
Notes
arXiv comment '13 pages, 13 figures', cats cs.DC, no venue claim. Abstract is the source of the H20/64-GPU numbers and states the paper reports deployment in the authors' own production environment. Author list from the arXiv API: Zhiyuan Tan, Dejiang Zhu, Jingzhe Jiang, Yihao Zheng, Yang Tian, Tao Wang, Minchen Yu.
Cross-references
This record references no other records.