VEQ: Modality-Adaptive Quantization for MoE Vision-Language Models
Mixture-of-Experts(MoE) Vision-Language Models(VLMs) offer remarkable performance but incur prohibitive memory and computational costs, making compression essential. Post-Training Quantization (PTQ) is an effective training-free technique to address the massive memory and computation overhead. Exist…