arXiv:2606.04980 AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization

Calibration-free expert bit allocation: experts with more heavy-tailed weight spectra are better trained and should get higher bit-widths. Motivated explicitly by frontier MoE models being trained on proprietary data, so calibration sets misestimate expert utilization.