inference/research
verifiedhigh · 0.85updated 2026-10-18

arXiv:2606.21868 - WiSP: A Working-Set View of Mixture-of-Experts Serving on Extremely Low-Resource Hardware

paper

Fields

id
sources/pap-wisp-working-set-moe-arxiv
Publisher
arXiv
Kind
paper
Published
2026-06-20
Accessed
2026-10-18
notes
arXiv:2606.21868v2, first submitted 2026-06-20, revised 2026-08-30. Comment on the abs page: 17 pages, 5 figures, 6 tables; v2 re-measured all headline results on a physically constrained 24 GiB RTX 3090 and adds discussion of concurrent work. The HTML header still says Preprint, Under Review, and the page-layout warning says the source violates the ICML style, but the abs comment does not name an accepted venue, so this source is the preprint. Authors Jiamu Zhang, Liang Wu, Mayank Darbari, Liangjie Hong, all Nokia, Sunnyvale. Code linked from the abstract: https://github.com/nokia-applied-research/WiSP. HTML of v2 read on 2026-10-18 (abstract, Sections 1-6, Appendices B-F). Every number in the paper record comes from that HTML: Figure 2 and Section 4 for the prefetch negative, Table 2 and Figure 3 for the 3090 iso-VRAM decode numbers, Table 3 for the OLMoE split, Table 4 for the live resize, Appendix C for the fused-MoE patch and the FP8 paging path. The paper is its own measurement; there is no independent reproduction.

Notes

arXiv:2606.21868v2, first submitted 2026-06-20, revised 2026-08-30. Comment on the abs page: 17 pages, 5 figures, 6 tables; v2 re-measured all headline results on a physically constrained 24 GiB RTX 3090 and adds discussion of concurrent work. The HTML header still says Preprint, Under Review, and the page-layout warning says the source violates the ICML style, but the abs comment does not name an accepted venue, so this source is the preprint. Authors Jiamu Zhang, Liang Wu, Mayank Darbari, Liangjie Hong, all Nokia, Sunnyvale. Code linked from the abstract: https://github.com/nokia-applied-research/WiSP. HTML of v2 read on 2026-10-18 (abstract, Sections 1-6, Appendices B-F). Every number in the paper record comes from that HTML: Figure 2 and Section 4 for the prefetch negative, Table 2 and Figure 3 for the 3090 iso-VRAM decode numbers, Table 3 for the OLMoE split, Table 4 for the live resize, Appendix C for the fused-MoE patch and the FP8 paging path. The paper is its own measurement; there is no independent reproduction.

Cross-references

This record references no other records.