inference/research
verifiedhigh · 0.90updated 2026-10-18

arXiv:2410.22134 - ProMoE: Fast MoE-based LLM Serving using Proactive Caching

paper

Fields

id
sources/pap-promoe-arxiv
Publisher
arXiv
Kind
paper
Published
2025-09-01
Accessed
2026-10-18
notes
arXiv:2410.22134, submitted 2024-10-29 (v1), last revised 2025-09-01 (v3). DOI 10.48550/arXiv.2410.22134 is the arXiv-issued DataCite DOI, not a proceedings DOI. The v3 HTML lists four authors (Xiaoniu Song, Zihang Zhong, Rong Chen, Haibo Chen) at the Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University, with Zihang Zhong also at Zhejiang University. No Crossref proceedings deposit was found on 2026-10-18: a bibliographic query for the title and an author query for Xiaoniu Song both returned zero matching works, so venue stays arxiv-preprint. Numbers cited from this source were read from the v3 HTML, not a secondary summary. The paper describes a 6,600-line C++ extension of transformers and llama.cpp but gives no code URL.

Notes

arXiv:2410.22134, submitted 2024-10-29 (v1), last revised 2025-09-01 (v3). DOI 10.48550/arXiv.2410.22134 is the arXiv-issued DataCite DOI, not a proceedings DOI. The v3 HTML lists four authors (Xiaoniu Song, Zihang Zhong, Rong Chen, Haibo Chen) at the Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University, with Zihang Zhong also at Zhejiang University. No Crossref proceedings deposit was found on 2026-10-18: a bibliographic query for the title and an author query for Xiaoniu Song both returned zero matching works, so venue stays arxiv-preprint. Numbers cited from this source were read from the v3 HTML, not a secondary summary. The paper describes a 6,600-line C++ extension of transformers and llama.cpp but gives no code URL.

Cross-references

This record references no other records.