arXiv:2505.05799 MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design

Two mechanism claims plus numbers: linear blocks exhibit varying quantization sensitivity and divergent expert activation frequencies create heterogeneous compute, so mixed-precision must be co-designed with the hardware. Reports 2.4 lower Wikitext-2 perplexity than GPTQ at 2.25-bit, up to 3.4x speedup over full precision, and up to 29.4% speedup over uniform quantization at equivalent accuracy with 5-bit W/A. Auto-generates mixed-precision GroupGEMM kernels.