arXiv:2406.08155 QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Experts

Fields

id

sources/qlab2-arxiv-quantmoebench

URL

https://arxiv.org/abs/2406.08155

Publisher

arXiv

Kind

paper

Published

2024-06-12

Accessed

2026-10-03

notes

The shared-vs-token-conditioned expert precision finding: because shared experts are accessed by ALL tokens while token-conditioned experts are selectively activated, shared experts potentially need HIGHER precision. Also frames why a single fixed precision for the whole MoE is suboptimal.

Notes

The shared-vs-token-conditioned expert precision finding: because shared experts are accessed by ALL tokens while token-conditioned experts are selectively activated, shared experts potentially need HIGHER precision. Also frames why a single fixed precision for the whole MoE is suboptimal.

Cross-references

This record references no other records.