inference/research
verifiedhigh · 0.90updated 2026-10-03

arXiv:2506.13329 EAQuant: Enhancing PTQ for MoE Models via Expert-Aware Optimization

paper

Fields

id
sources/qlab2-arxiv-eaquant
Publisher
arXiv
Kind
paper
Published
2025-06-16
Accessed
2026-10-03
notes
Routing-instability-is-the-real-problem framing: activation outliers, routing instability, and sparse expert calibration are named as the three failures of generic PTQ on MoE. Introduces routing consistency alignment to preserve expert selection post-quantization. Reports average accuracy gains of 1.15-13.81% at W4A4/W3A4/W3A3/W2A4 across three MoE architectures.

Notes

Routing-instability-is-the-real-problem framing: activation outliers, routing instability, and sparse expert calibration are named as the three failures of generic PTQ on MoE. Introduces routing consistency alignment to preserve expert selection post-quantization. Reports average accuracy gains of 1.15-13.81% at W4A4/W3A4/W3A3/W2A4 across three MoE architectures.

Cross-references

This record references no other records.