Zhanhao Xie

Automated Fine-Grained Mixture-of-Experts Quantization

The Mixture of Experts (MoE) architecture enables efficient model scaling through conditional computation, where only subset of parameters are activated per input. However, this distributed architecture poses unprecedented challenges for model compression, as conventional quantization methods optimi…