Jeonggeun Song

ViBid: Linear Vision Transformer with Bidirectional Normalization

The vision transformer has achieved state-of-the-art performance in various vision tasks; however, the memory consumption is larger than those of previous convolutional neural network based models because of $O(N^2)$ time and memory complexity of the general self-attention models. Many approaches ai…