arXiv:2310.16795 - QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models

Fields

id

sources/pap-qmoe-sub-1-bit-arxiv

URL

https://arxiv.org/abs/2310.16795

Publisher

arXiv

Kind

paper

Published

2023-10-25

Accessed

2026-10-18

notes

arXiv:2310.16795, submitted 2023-10-25 as v1; the abs page offers only that version (HTML at https://arxiv.org/html/2310.16795v1). The abs page carries no venue comment, and the authors' own citation block in the repository README cites it as an arXiv preprint. Crossref title and bibliographic queries on 2026-10-18 returned no proceedings deposit for this title (the top hits were unrelated compression and trillion-parameter papers), so venue stays arxiv-preprint. Numbers and the mechanism were read from the v1 HTML at https://ar5iv.labs.arxiv.org/html/2310.16795, not a secondary summary.

Notes

arXiv:2310.16795, submitted 2023-10-25 as v1; the abs page offers only that version (HTML at https://arxiv.org/html/2310.16795v1). The abs page carries no venue comment, and the authors' own citation block in the repository README cites it as an arXiv preprint. Crossref title and bibliographic queries on 2026-10-18 returned no proceedings deposit for this title (the top hits were unrelated compression and trillion-parameter papers), so venue stays arxiv-preprint. Numbers and the mechanism were read from the v1 HTML at https://ar5iv.labs.arxiv.org/html/2310.16795, not a secondary summary.

Cross-references

This record references no other records.