Ming-Guang Lin

TSPTQ-ViT: Two-Scaled Post-Training Quantization for Vision Transformer

Vision transformers (ViTs) have achieved remarkable performance in various computer vision tasks. However, intensive memory and computation requirements impede ViTs from running on resource-constrained edge devices. Due to the non-normally distributed values after Softmax and GeLU, post- training qu…