← Search

Xiangguo Zhang

4 accepted papers

2024

Selective Focus: Investigating Semantics Sensitivity in Post-training Quantization for Lane Detection

AAAI 2024technical

Lane detection (LD) plays a crucial role in enhancing the L2+ capabilities of autonomous driving, capturing widespread attention. The Post-Processing Quantization (PTQ) could facilitate the practical application of LD models, enabling fast speeds and limited memories without labeled data. However, p…

2023

Outlier Suppression+: Accurate quantization of large language models by equivalent and effective shifting and scaling

EMNLP 2023long main

Post-training quantization (PTQ) of transformer language models faces significant challenges due to the existence of detrimental outliers in activations. We observe that these outliers are concentrated in specific channels and are asymmetric across channels. To address this issue, we propose the Out…

Cited by 0SourcecodeScholar
2022

Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models

NeurIPS 2022accept

Transformer architecture has become the fundamental element of the widespread natural language processing~(NLP) models. With the trends of large NLP models, the increasing memory and computation costs hinder their efficient deployment on resource-limited devices. Therefore, transformer quantization…

2021

Diversifying Sample Generation for Accurate Data-Free Quantization

CVPR 2021poster

Quantization has emerged as one of the most prevalent approaches to compress and accelerate neural networks. Recently, data-free quantization has been widely studied as a practical and promising solution. It synthesizes data for calibrating the quantized model according to the batch normalization (B…

Cited by 113PDFScholar