arXiv:2411.01433 - HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference
paper
Fields
id
sources/pap-hobbit-mixed-precision-expert-offload-arxivPublisher
arXiv
Kind
paper
Published
2024-11-06
Accessed
2026-10-18
notes
arXiv:2411.01433, submitted 2024-11-03 (v1), last revised 2024-11-06 (v2). The abs page carries no venue comment. Crossref bibliographic search on 2026-10-18 returned no proceedings deposit for this title (only unrelated offloading and Tolkien hits), so venue stays arxiv-preprint. Numbers and the mechanism were read from the v2 HTML at https://ar5iv.labs.arxiv.org/html/2411.01433, not a secondary summary. The HTML cites llama.cpp as the implementation base and does not link a HOBBIT repository; a GitHub repository search for the system on 2026-10-18 returned zero hits.
Notes
arXiv:2411.01433, submitted 2024-11-03 (v1), last revised 2024-11-06 (v2). The abs page carries no venue comment. Crossref bibliographic search on 2026-10-18 returned no proceedings deposit for this title (only unrelated offloading and Tolkien hits), so venue stays arxiv-preprint. Numbers and the mechanism were read from the v2 HTML at https://ar5iv.labs.arxiv.org/html/2411.01433, not a secondary summary. The HTML cites llama.cpp as the implementation base and does not link a HOBBIT repository; a GitHub repository search for the system on 2026-10-18 returned zero hits.
Cross-references
This record references no other records.