Dahun Choi

GradQ-ViT: Robust and Efficient Gradient Quantization for Vision Transformers

Advancements in hardware accelerators, such as graphics processing units and neural processing units, have significantly propelled computer vision research. The vision transformer (ViT), leveraging the multi-head self-attention (MHSA) mechanism, has surpassed convolutional neural networks (CNNs) in…