2022
Quadapter: Adapter for GPT-2 Quantization
EMNLP 2022finding
Transformer language models such as GPT-2 are difficult to quantize because of outliers in the activations leading to a large quantization error. To adapt to the error, one must use quantization-aware training, which entails a fine-tuning process based on the dataset and the training pipeline identi…