Honghui Lin

Look and Think: Intrinsic Unification of Self-Attention and Convolution for Spatial-Channel Specificity

Convolution and self-attention are popular paradigms and many works take them as two separate components to explore their potential combination. In this work, we consider their intrinsic properties in spatial and channel domains for vision representation. Convolution has the great property of channe…