arXiv:2610.15417 - SpecFit: Not All Draft Tokens Cost the Same in Offloaded MoE Inference

Fields

id

sources/pap-specfit-offloaded-moe-arxiv

URL

https://arxiv.org/abs/2610.15417

Publisher

arXiv

Kind

paper

Published

2026-10-11

Accessed

2026-10-18

Archived URL

https://arxiv.org/pdf/2610.15417v1

notes

arXiv:2610.15417v1, submitted 2026-10-11, 16 pages, preprint with no venue in the arXiv comment. Authors Hongliang Cao and Siqi Wang and Hailong Yang (Beihang University), Xiuyu Li and Jingmin Zhu (Monash University), Ziming Wang (HKUST). PDF at https://arxiv.org/pdf/2610.15417v1 read in full on 2026-10-18. All numbers in the paper record come from this PDF: Section 4 and Tables 2-4 for the throughput and transfer counters, Appendix B for the model geometry (48 MoE layers, 128 experts, top-8), the fitted cost coefficients, and the measurement protocol. The paper is its own measurement; there is no independent reproduction.

Notes

arXiv:2610.15417v1, submitted 2026-10-11, 16 pages, preprint with no venue in the arXiv comment. Authors Hongliang Cao and Siqi Wang and Hailong Yang (Beihang University), Xiuyu Li and Jingmin Zhu (Monash University), Ziming Wang (HKUST). PDF at https://arxiv.org/pdf/2610.15417v1 read in full on 2026-10-18. All numbers in the paper record come from this PDF: Section 4 and Tables 2-4 for the throughput and transfer counters, Appendix B for the model geometry (48 MoE layers, 128 experts, top-8), the fitted cost coefficients, and the measurement protocol. The paper is its own measurement; there is no independent reproduction.

Cross-references

This record references no other records.