arXiv:2606.05688 Value-and-Structure Alignment for Routing-Consistent Quantization of Mixture-of-Experts Models (VSRAQ)
paper
Fields
id
sources/qlab2-arxiv-vsraqPublisher
arXiv
Kind
paper
Published
2026-06-04
Accessed
2026-10-03
notes
Top-k routing is a discrete decision: small quantization-induced perturbations can change which experts are selected, altering the computation path. Combines value alignment (match routing-relevant logits/scores) with structure alignment (preserve expert ordering and top-k decision boundaries).
Notes
Top-k routing is a discrete decision: small quantization-induced perturbations can change which experts are selected, altering the computation path. Combines value alignment (match routing-relevant logits/scores) with structure alignment (preserve expert ordering and top-k decision boundaries).
Cross-references
This record references no other records.