2024
Towards Next-Level Post-Training Quantization of Hyper-Scale Transformers
NeurIPS 2024poster
With the increasing complexity of generative AI models, post-training quantization (PTQ) has emerged as a promising solution for deploying hyper-scale models on edge devices such as mobile and TVs. Existing PTQ schemes, however, consume considerable time and resources, which could be a bottleneck in…