Liang Lin*

Stripe Observation Guided Inference Cost-free Attention Mechanism

"Structural re-parameterization (SRP) is a novel technique series that boosts neural networks without introducing any computational costs in inference stage. The existing SRP methods have successfully considered many architectures, such as normalizations, convolutions, etc. However, the widely used…