Yundong Gai

ATQ: Activation Transformation forWeight-Activation Quantization of Large Language Models

There are many emerging quantization methods to resolve the problem that the huge demand on computational and storage costs hinders the deployment of Large language models (LLMs). However, their accuracy performance still can not satisfy the entire academic and industry community. In this work, we p…